-- Logs begin at Tue 2021-06-01 11:59:15 UTC, end at Tue 2021-06-01 12:51:37 UTC. --
Jun 01 12:26:23.892463 dv-cinder-793515-2-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
Jun 01 12:26:24.861232 dv-cinder-793515-2-iscsi neutron-server[91839]: Beware of the coming changes in the project packaging
Jun 01 12:26:24.861849 dv-cinder-793515-2-iscsi neutron-server[91839]: https://github.com/svinota/pyroute2/discussions/786
Jun 01 12:26:26.317205 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.common.config [-] Logging enabled!
Jun 01 12:26:26.317856 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 12:26:26.317977 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91839) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 12:26:26.321100 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.common.config [-] Logging enabled!
Jun 01 12:26:26.321354 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev249
Jun 01 12:26:26.321659 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91839) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
Jun 01 12:26:26.322640 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 12:26:26.323016 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 12:26:26.323486 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 12:26:26.323835 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 12:26:26.324220 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 12:26:26.324576 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.324878 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.325695 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.325928 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.326224 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.326517 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.326800 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.327090 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.327388 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.327672 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.327955 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.328240 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.328471 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.328790 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.329077 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.329361 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.329584 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] debug                          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.329861 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.330296 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.330719 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.330998 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.331283 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.331562 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.331831 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.332102 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.332385 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.332992 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] host                           = dv-cinder-793515-2-iscsi {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.333269 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.333555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.333840 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.334121 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.334392 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.334667 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.334949 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.335220 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.335491 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.335763 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.336048 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.336333 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.336649 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.336874 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.337095 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.337379 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.337662 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.337940 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.338209 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.338480 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.338751 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.339022 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.339287 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.339567 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.339847 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.340126 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.340396 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.340710 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.341526 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.341797 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.342079 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.342351 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.342620 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.342891 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.343175 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.343447 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.343712 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.344007 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.344289 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.344594 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.344877 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.345150 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.345430 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.345700 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.345968 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.346236 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.346507 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.346772 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.347052 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.347323 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.347593 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.347874 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.348136 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.348417 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:26.348734 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.349030 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.349329 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.349610 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.349902 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.350180 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.350464 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.350740 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.351025 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.351310 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.351597 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.351875 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.352161 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.352434 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.352749 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.353055 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.353350 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.353644 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.353919 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.354194 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.354467 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.354743 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.355033 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.355329 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.355618 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.355892 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.356170 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.357006 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.357285 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.357560 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.357843 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.358131 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.358407 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.358684 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.358965 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.359241 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.359513 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.359781 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.360057 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.360343 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.360644 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.360913 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.361180 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.361456 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.361726 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.362010 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.362288 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.362559 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.362831 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.363106 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.363377 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.363654 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.363926 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.364195 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.364471 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.364767 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.365039 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.365310 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.365580 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.365852 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.366122 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.366393 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.366668 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.366939 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.367210 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.367481 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.367757 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.368030 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.368315 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.368639 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.368918 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.369195 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.369471 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.369747 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.370021 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.370295 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.370569 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.370845 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.371114 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.371400 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.371681 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.371983 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.372821 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.373103 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.373398 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.373675 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.373961 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.374238 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.374517 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.374806 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.375092 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.375382 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.375673 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.375965 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.376255 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.376570 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.376852 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.377158 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.377438 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:26.377656 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 12:26:26.377902 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=91839) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
Jun 01 12:26:26.728371 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=91839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:26:26.728686 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=91839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:26:26.728973 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=91839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:26:26.729451 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [-] Loading core plugin: ml2
Jun 01 12:26:27.123550 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.123777 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.124010 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.125231 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.125502 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.125767 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.160446 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.160747 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.161020 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.174484 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.174756 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.175022 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.204837 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.205112 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.205374 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.242412 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.242688 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.242954 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.474496 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f7a2740aee0> agent after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.475100 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f7a2740aee0> agent after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.475100 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7f7a2740ae50> segment precommit_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.475279 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7f7a2740adc0> network precommit_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.476005 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7f7a274309d0> segment before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.599278 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> network before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.599586 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7f7a274a00d0> agent before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.599872 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> network before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.600152 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> port before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.600422 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> port before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.600757 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> segment precommit_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.601021 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> segment precommit_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.601281 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> segment after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.601538 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> segment after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.601822 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> network after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.602085 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> network precommit_delete 0 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.602351 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> port provisioning_complete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.602619 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.602877 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> rbac-policy after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.603156 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> agent after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.603430 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> subnet after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.604775 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> subnet precommit_delete 0 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.605072 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.605345 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.605642 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> segment_host_mapping after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.606005 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> port after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.606269 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> port after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.610023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> port after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.610023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.610023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.610023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f7a27d48d60>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.610023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:27.610023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:27.610517 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:27.610517 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:27.610517 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:27.610517 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:27.610517 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
Jun 01 12:26:27.612365 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
Jun 01 12:26:27.616240 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Jun 01 12:26:27.619996 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(750, 799)])])
Jun 01 12:26:27.621653 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
Jun 01 12:26:27.622131 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
Jun 01 12:26:27.622467 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
Jun 01 12:26:27.622852 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Jun 01 12:26:27.625804 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Jun 01 12:26:27.626062 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Jun 01 12:26:27.630804 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 12:26:27.655519 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
Jun 01 12:26:27.655970 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7f7a275937f0>> qos_plugin after_init 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.656269 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=91839) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
Jun 01 12:26:27.656661 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7f7a27593520>> logging-plugin after_init 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.658014 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=91839) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
Jun 01 12:26:27.658300 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
Jun 01 12:26:27.658549 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
Jun 01 12:26:27.662154 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f7a2726e2b0>> floatingip before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.662431 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f7a2726e2b0>> port before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:27.734449 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Jun 01 12:26:27.734639 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Jun 01 12:26:27.734835 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Jun 01 12:26:27.735214 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
Jun 01 12:26:27.765253 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_db.sqlalchemy.engines [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Jun 01 12:26:28.105066 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing driver for type 'gre'
Jun 01 12:26:28.105505 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] gre ID ranges: [(1, 1000)]
Jun 01 12:26:28.160794 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing driver for type 'local'
Jun 01 12:26:28.161122 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing driver for type 'vlan'
Jun 01 12:26:28.174747 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] VlanTypeDriver initialization complete
Jun 01 12:26:28.175062 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing driver for type 'vxlan'
Jun 01 12:26:28.175575 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] vxlan ID ranges: [(1, 1000)]
Jun 01 12:26:28.229018 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing extension driver 'port_security'
Jun 01 12:26:28.229329 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.extensions.port_security [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] PortSecurityExtensionDriver initialization complete
Jun 01 12:26:28.229659 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing mechanism driver 'openvswitch'
Jun 01 12:26:28.229981 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing mechanism driver 'hyperv'
Jun 01 12:26:28.237070 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.plugins.ml2.plugin [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=91839) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:26:28.237823 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a2731e4c0>> port after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.238200 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a2731e4c0>> port after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.238548 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a2731e4c0>> port after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.238933 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a2731e730>> subnet after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.239282 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a2731e730>> subnet after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.239627 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a2731e730>> subnet after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.240004 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc93a0>> network after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.240354 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc93a0>> network after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.240720 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc93a0>> network after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.241097 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc9610>> security_group after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.241439 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc9610>> security_group after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.241776 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc9610>> security_group after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.242154 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc98b0>> security_group_rule after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.242493 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc98b0>> security_group_rule after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.242831 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc98b0>> security_group_rule after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.243204 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc9af0>> address_group after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.243542 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc9af0>> address_group after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.243875 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f7a26dc9af0>> address_group after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.244207 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] ML2 OVO RPC backend initialized. {{(pid=91839) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
Jun 01 12:26:28.244996 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> router_interface after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.245348 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> router_interface after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.245766 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> network before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.246140 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> networks before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.246452 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> port before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.246792 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> ports before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.247126 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> subnet before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.247461 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> subnets before_response 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.247803 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> network after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.248137 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> network after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.248470 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> network after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.248827 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> port after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.249162 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> port after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.249507 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> port after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.249827 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> subnet after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.250159 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> subnet after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.250487 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f7a26dc9f40>> subnet after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.251048 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.plugin [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Modular L2 Plugin initialization complete
Jun 01 12:26:28.251374 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading services supported by the core plugin {{(pid=91839) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
Jun 01 12:26:28.251696 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.plugins.ml2.managers [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Got port-security extension from driver 'port_security'
Jun 01 12:26:28.252155 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.extensions.vlantransparent [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Disabled vlantransparent extension.
Jun 01 12:26:28.252684 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=91839) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Jun 01 12:26:28.252997 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: router
Jun 01 12:26:28.290138 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router_interface before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.290525 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router after_create 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.290895 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router before_create 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.291258 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router_interface before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.291625 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router_interface after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.291977 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router after_delete 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.292332 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> floatingip after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.292726 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router after_create 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.293069 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router after_update 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.293429 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router after_update 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.293763 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router_gateway after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.294665 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router after_update 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.295066 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router precommit_update 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.295435 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7f7a273e0940> port after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.295780 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7f7a273e0a60> port after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.296112 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7f7a273e09d0> subnet after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.296445 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7f7a273e0820> subnetpool_address_scope after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.296818 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> port precommit_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.297168 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router precommit_create 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.297505 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7f7a273d8430> port before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.297844 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router precommit_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.298196 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router after_update 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.298535 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router precommit_delete 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.298878 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router precommit_create 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.299239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router_interface after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.299580 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> router precommit_update 55549900 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.300102 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f7a26dc9d90>> network after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.300824 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Tracking information for resource: router configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:28.301155 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Tracking information for resource: floatingip configured {{(pid=91839) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
Jun 01 12:26:28.306148 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.db.l3_agentschedulers_db [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
Jun 01 12:26:28.306732 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function _notify_l3_agent_port_update at 0x7f7a26d43dc0> port after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.307086 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function _notify_l3_agent_new_port at 0x7f7a26d43ca0> port after_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.307439 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function _notify_port_delete at 0x7f7a26d43d30> port after_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.307787 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7f7a26d480d0> port after_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.308754 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f7a26d6e1f0>> router before_create 55550100 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.309376 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f7a26d6e1f0>> router precommit_delete 55550100 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.310029 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f7a26d6e1f0>> router precommit_create 55550100 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.310634 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f7a26d6e1f0>> router precommit_update 55550100 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.319232 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.services.provider_configuration [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service providers = [] {{(pid=91839) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Jun 01 12:26:28.319788 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.db.servicetype_db [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=91839) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Jun 01 12:26:28.323043 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.services.service_base [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=91839) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 12:26:28.323393 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.services.service_base [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=91839) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 12:26:28.323732 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.services.service_base [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=91839) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 12:26:28.324632 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.services.service_base [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=91839) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Jun 01 12:26:28.325065 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.services.service_base [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Default provider is not specified for service type L3_ROUTER_NAT
Jun 01 12:26:28.326162 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.326482 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
Jun 01 12:26:28.337662 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded METERING plugin. Description: METERING {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.337994 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: auto_allocate
Jun 01 12:26:28.344779 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f7a26d8f430> network precommit_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.345151 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f7a26d8f430> network precommit_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.345674 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.345987 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: tag
Jun 01 12:26:28.352830 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.353158 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: timestamp
Jun 01 12:26:28.357079 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.357357 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: network_ip_availability
Jun 01 12:26:28.362798 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f7a26d84e80>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.363168 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f7a26d84e80>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.363522 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f7a26d84e80>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.364233 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.364573 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: flavors
Jun 01 12:26:28.369463 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.369789 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading Plugin: revisions
Jun 01 12:26:28.374032 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=91839) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Jun 01 12:26:28.374417 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_concurrency.lockutils [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.645s {{(pid=91839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:26:28.375140 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=91839) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
Jun 01 12:26:28.375470 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Initializing extension manager.
Jun 01 12:26:28.375970 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: __init__.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.376307 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: __pycache__ {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.376680 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.377013 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: address_group.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.377765 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.378334 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: address-group
Jun 01 12:26:28.378653 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: address_scope.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.379356 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.379860 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: address-scope
Jun 01 12:26:28.380183 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: admin_state_down_before_update.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.381119 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.381631 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: router-admin-state-down-before-update
Jun 01 12:26:28.381953 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: agent.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.382637 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.383138 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: agent
Jun 01 12:26:28.383457 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: agent_resources_synced.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.384349 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.384889 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: agent-resources-synced
Jun 01 12:26:28.385209 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: allowedaddresspairs.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.386965 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.387489 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: allowed-address-pairs
Jun 01 12:26:28.388347 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: auto_allocated_topology.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.389423 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.389944 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: auto-allocated-topology
Jun 01 12:26:28.390269 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: availability_zone.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.390947 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.391454 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: availability_zone
Jun 01 12:26:28.391773 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: availability_zone_filter.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.392700 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.393207 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: availability_zone_filter
Jun 01 12:26:28.393525 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: data_plane_status.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.394414 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.394918 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension data-plane-status not supported by any of loaded plugins
Jun 01 12:26:28.395235 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: default_subnetpools.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.396124 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.396664 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: default-subnetpools
Jun 01 12:26:28.396984 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: dhcpagentscheduler.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.397783 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.398290 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: dhcp_agent_scheduler
Jun 01 12:26:28.398602 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: dns.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.399508 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.400471 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension dns-integration not supported by any of loaded plugins
Jun 01 12:26:28.400471 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: dns_domain_ports.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.401228 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.401727 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension dns-domain-ports not supported by any of loaded plugins
Jun 01 12:26:28.402038 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: dvr.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.402701 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.403219 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: dvr
Jun 01 12:26:28.404083 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: empty_string_filtering.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.405005 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.405506 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: empty-string-filtering
Jun 01 12:26:28.405822 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.406718 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.407219 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Jun 01 12:26:28.407686 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.408524 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.408947 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Jun 01 12:26:28.409265 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: external_net.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.410157 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.410668 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: external-net
Jun 01 12:26:28.410985 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: extra_dhcp_opt.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.411873 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.412380 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: extra_dhcp_opt
Jun 01 12:26:28.412730 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: extraroute.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.413618 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.414124 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: extraroute
Jun 01 12:26:28.414449 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: extraroute_atomic.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.415470 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.415983 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: extraroute-atomic
Jun 01 12:26:28.416295 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: filter_validation.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.416970 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.417474 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: filter-validation
Jun 01 12:26:28.417786 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: fip_pf_description.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.418904 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.419403 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Jun 01 12:26:28.419718 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: fip_port_details.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.420650 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.421155 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: fip-port-details
Jun 01 12:26:28.421471 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: flavors.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.422703 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.423212 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: flavors
Jun 01 12:26:28.423532 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.425233 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.425757 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Jun 01 12:26:28.426093 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: floatingip_pools.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.426781 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.427294 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: floatingip-pools
Jun 01 12:26:28.427622 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: ip_allocation.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.428532 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.429059 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension ip_allocation not supported by any of loaded plugins
Jun 01 12:26:28.429380 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: ip_substring_port_filtering.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.430275 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.430787 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: ip-substring-filtering
Jun 01 12:26:28.431108 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l2_adjacency.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.432011 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.432533 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension l2_adjacency not supported by any of loaded plugins
Jun 01 12:26:28.432859 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l3.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.433841 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.434357 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: router
Jun 01 12:26:28.434706 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l3_conntrack_helper.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.437041 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.437569 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Jun 01 12:26:28.437900 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l3_ext_gw_mode.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.438832 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.439341 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: ext-gw-mode
Jun 01 12:26:28.439664 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l3_ext_ha_mode.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.440608 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.441109 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: l3-ha
Jun 01 12:26:28.441429 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l3_flavors.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.442682 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.442859 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: l3-flavors
Jun 01 12:26:28.443179 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.444187 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.444649 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: l3-port-ip-change-not-allowed
Jun 01 12:26:28.444958 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: l3agentscheduler.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.446029 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.446522 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: l3_agent_scheduler
Jun 01 12:26:28.446842 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: logging.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.448536 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.448901 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension logging not supported by any of loaded plugins
Jun 01 12:26:28.449224 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: metering.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.449969 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.451072 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: metering
Jun 01 12:26:28.451391 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.452472 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.453014 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: metering_source_and_destination_fields
Jun 01 12:26:28.453333 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: multiprovidernet.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.454381 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.454902 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: multi-provider
Jun 01 12:26:28.455426 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: netmtu.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.456117 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.456659 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: net-mtu
Jun 01 12:26:28.456977 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: netmtu_writable.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.458133 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.458638 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: net-mtu-writable
Jun 01 12:26:28.458959 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: network_availability_zone.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.459625 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.460133 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: network_availability_zone
Jun 01 12:26:28.460450 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: network_ip_availability.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.461563 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.462080 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: network-ip-availability
Jun 01 12:26:28.462392 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: network_segment_range.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.463169 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.463679 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension network-segment-range not supported by any of loaded plugins
Jun 01 12:26:28.464001 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: pagination.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.464995 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.465321 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: pagination
Jun 01 12:26:28.465638 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: port_device_profile.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.467092 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.467605 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: port-device-profile
Jun 01 12:26:28.467922 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: port_mac_address_regenerate.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.468928 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.469465 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: port-mac-address-regenerate
Jun 01 12:26:28.469779 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: port_numa_affinity_policy.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.470666 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.471176 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: port-numa-affinity-policy
Jun 01 12:26:28.471487 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: port_resource_request.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.472380 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.472912 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension port-resource-request not supported by any of loaded plugins
Jun 01 12:26:28.473229 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: portbindings.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.474145 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.474647 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: binding
Jun 01 12:26:28.475249 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: portbindings_extended.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.476253 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.476803 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: binding-extended
Jun 01 12:26:28.477122 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: portsecurity.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.478024 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.478538 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: port-security
Jun 01 12:26:28.478855 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: project_id.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.479827 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.480152 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: project-id
Jun 01 12:26:28.480470 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: providernet.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.481440 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.481954 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: provider
Jun 01 12:26:28.482271 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.485801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.486331 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos not supported by any of loaded plugins
Jun 01 12:26:28.486654 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_bw_limit_direction.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.487886 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.488405 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Jun 01 12:26:28.488756 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.489665 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.490183 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Jun 01 12:26:28.490505 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_default.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.491405 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.491923 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-default not supported by any of loaded plugins
Jun 01 12:26:28.492246 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_fip.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.492923 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.493424 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-fip not supported by any of loaded plugins
Jun 01 12:26:28.493740 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_gateway_ip.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.494644 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.495152 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-gateway-ip not supported by any of loaded plugins
Jun 01 12:26:28.495469 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_port_network_policy.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.496362 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.496893 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-port-network-policy not supported by any of loaded plugins
Jun 01 12:26:28.497239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_rule_type_details.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.498131 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.498639 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-rule-type-details not supported by any of loaded plugins
Jun 01 12:26:28.498956 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: qos_rules_alias.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.499995 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.500503 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension qos-rules-alias not supported by any of loaded plugins
Jun 01 12:26:28.500852 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: quotasv2.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.501934 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.502257 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: quotas
Jun 01 12:26:28.502575 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: quotasv2_detail.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.504195 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.504542 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: quota_details
Jun 01 12:26:28.504870 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: rbac.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.505930 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.506446 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: rbac-policies
Jun 01 12:26:28.506773 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: rbac_address_group.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.507690 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.508204 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: rbac-address-group
Jun 01 12:26:28.508545 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: rbac_address_scope.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.509456 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.509968 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: rbac-address-scope
Jun 01 12:26:28.510290 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: rbac_security_groups.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.511187 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.511698 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: rbac-security-groups
Jun 01 12:26:28.512016 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: rbac_subnetpool.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.513460 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.513968 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: rbac-subnetpool
Jun 01 12:26:28.514285 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: revisionifmatch.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.515187 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.515697 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: revision-if-match
Jun 01 12:26:28.516018 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: revisions.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.517152 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.517665 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: standard-attr-revisions
Jun 01 12:26:28.517987 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: router_availability_zone.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.518655 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.519174 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: router_availability_zone
Jun 01 12:26:28.519496 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: routerservicetype.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.520408 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.520975 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension router-service-type not supported by any of loaded plugins
Jun 01 12:26:28.521297 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.522232 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.522796 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: security-groups-normalized-cidr
Jun 01 12:26:28.523039 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: security_groups_port_filtering.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.523990 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.524458 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: port-security-groups-filtering
Jun 01 12:26:28.524810 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: security_groups_remote_address_group.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.525722 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.526229 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: security-groups-remote-address-group
Jun 01 12:26:28.526544 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: securitygroup.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.536608 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.537139 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: security-group
Jun 01 12:26:28.537469 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: segment.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.538260 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.538765 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension segment not supported by any of loaded plugins
Jun 01 12:26:28.539088 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.540023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.540551 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Jun 01 12:26:28.540876 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: servicetype.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.541981 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.542495 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: service-type
Jun 01 12:26:28.542819 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: sorting.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.543777 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.544137 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: sorting
Jun 01 12:26:28.544453 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: standard_attr_segment.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.545374 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.545893 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension standard-attr-segment not supported by any of loaded plugins
Jun 01 12:26:28.546233 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: standardattrdescription.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.546841 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.547344 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: standard-attr-description
Jun 01 12:26:28.547662 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: stateful_security_group.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.548588 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.549101 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: stateful-security-group
Jun 01 12:26:28.549423 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: stdattrs_common.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.549992 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Jun 01 12:26:28.550308 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.551286 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.551795 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
Jun 01 12:26:28.552111 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: subnet_onboard.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.553247 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.553757 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: subnet_onboard
Jun 01 12:26:28.554075 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: subnet_segmentid_writable.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.555051 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.555557 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Jun 01 12:26:28.555875 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: subnet_service_types.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.556830 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.557339 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: subnet-service-types
Jun 01 12:26:28.557657 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: subnetallocation.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.558731 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.559250 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: subnet_allocation
Jun 01 12:26:28.559600 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.560253 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.560779 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: subnetpool-prefix-ops
Jun 01 12:26:28.561096 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.562011 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.562519 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Jun 01 12:26:28.562835 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: tagging.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.563925 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.564434 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: standard-attr-tag
Jun 01 12:26:28.564781 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: timestamp.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.565970 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.566486 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loaded extension: standard-attr-timestamp
Jun 01 12:26:28.566808 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: trunk.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.567819 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.568335 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension trunk not supported by any of loaded plugins
Jun 01 12:26:28.568693 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: trunk_details.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.569600 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.570113 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension trunk-details not supported by any of loaded plugins
Jun 01 12:26:28.570432 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: uplink_status_propagation.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.571335 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.571845 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension uplink-status-propagation not supported by any of loaded plugins
Jun 01 12:26:28.572165 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Loading extension file: vlantransparent.py {{(pid=91839) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
Jun 01 12:26:28.572857 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=91839) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
Jun 01 12:26:28.573360 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extension vlan-transparent not supported by any of loaded plugins
Jun 01 12:26:28.576400 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:network
Jun 01 12:26:28.577170 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:subnet
Jun 01 12:26:28.579076 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 12:26:28.579699 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:port
Jun 01 12:26:28.581015 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.581485 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service FLAVORS assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.582056 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.582479 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.583072 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:router
Jun 01 12:26:28.583721 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 12:26:28.584579 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service METERING assigned prefix: /metering {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.585910 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f7a26c643d0>> rbac-policy before_create 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.586276 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f7a26c643d0>> rbac-policy before_update 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.586621 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f7a26c643d0>> rbac-policy before_delete 55550000 {{(pid=91839) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:26:28.587757 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 12:26:28.588206 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:security_group
Jun 01 12:26:28.588906 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 12:26:28.589659 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service CORE assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.589984 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 12:26:28.590312 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] subnetpool is already registered
Jun 01 12:26:28.591588 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service CORE assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.591913 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 12:26:28.592239 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] subnetpool is already registered
Jun 01 12:26:28.594857 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.595283 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service FLAVORS assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.595869 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.596286 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.596643 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:router
Jun 01 12:26:28.596973 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] router is already registered
Jun 01 12:26:28.597557 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:floatingip
Jun 01 12:26:28.597883 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] floatingip is already registered
Jun 01 12:26:28.598503 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service METERING assigned prefix: /metering {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.599181 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of CountableResource for resource:rbac_policy
Jun 01 12:26:28.599508 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] rbac_policy is already registered
Jun 01 12:26:28.600143 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:security_group
Jun 01 12:26:28.600375 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] security_group is already registered
Jun 01 12:26:28.600996 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:security_group_rule
Jun 01 12:26:28.601327 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] security_group_rule is already registered
Jun 01 12:26:28.602006 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service CORE assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.602328 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 12:26:28.602649 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] subnetpool is already registered
Jun 01 12:26:28.603244 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.v2.resource_helper [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Service CORE assigned prefix:  {{(pid=91839) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
Jun 01 12:26:28.603566 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Creating instance of TrackedResource for resource:subnetpool
Jun 01 12:26:28.603884 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING neutron.quota.resource_registry [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] subnetpool is already registered
Jun 01 12:26:28.604536 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: extensions {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.606039 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: address-groups {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.607742 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: address-scopes {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.608930 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: agents {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.610090 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: auto-allocated-topology {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.611316 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: availability_zones {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.612655 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: dhcp-networks {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.614066 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: dhcp-agents {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.615478 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: routers {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.617295 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: flavors {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.618493 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: service_profiles {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.619723 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: next_providers {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.621265 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: service_profiles {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.622720 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: floatingip-pools {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.623920 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: routers {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.625864 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: floatingips {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.626947 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: l3-routers {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.628309 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: l3-agents {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.629745 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: metering-labels {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.631087 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: metering-label-rules {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.632350 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: network-ip-availabilities {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.633643 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: bindings {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.635292 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: quotas {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.636739 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: quotas {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.638675 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: rbac-policies {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.639966 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: security-groups {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.641208 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: security-group-rules {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.642430 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: service-providers {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.643636 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: subnetpools {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.646042 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: subnetpools {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.647478 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.649217 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.767839 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.769654 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.771424 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.773316 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.774997 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.776921 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.778732 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.780618 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron.api.extensions [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Extended resource: tags {{(pid=91839) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
Jun 01 12:26:28.786408 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING keystonemiddleware.auth_token [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
Jun 01 12:26:28.791219 dv-cinder-793515-2-iscsi neutron-server[91839]: WARNING keystonemiddleware.auth_token [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Jun 01 12:26:28.799779 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_concurrency.lockutils [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Acquired lock "singleton_lock" {{(pid=91839) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
Jun 01 12:26:28.800283 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_concurrency.lockutils [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Releasing lock "singleton_lock" {{(pid=91839) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
Jun 01 12:26:28.800947 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO oslo_service.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Starting 2 workers
Jun 01 12:26:28.805702 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Started child 91978 {{(pid=91839) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 12:26:28.810701 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Started child 91979 {{(pid=91839) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 12:26:28.811543 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:28.812358 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO neutron.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Neutron service started, listening on 0.0.0.0:9696
Jun 01 12:26:28.813041 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Notify callbacks [] for process, before_spawn {{(pid=91839) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:28.813217 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [-] (91978) wsgi starting up on http://0.0.0.0:9696
Jun 01 12:26:28.815590 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO oslo_service.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Starting 1 workers
Jun 01 12:26:28.816100 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:28.817524 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [-] (91979) wsgi starting up on http://0.0.0.0:9696
Jun 01 12:26:28.820808 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Started child 91980 {{(pid=91839) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 12:26:28.821339 dv-cinder-793515-2-iscsi neutron-server[91839]: INFO oslo_service.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Starting 1 workers
Jun 01 12:26:28.824479 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] calling RpcWorker wait() {{(pid=91980) _wait /opt/stack/neutron/neutron/service.py:128}}
Jun 01 12:26:28.826013 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] returning from RpcWorker wait() {{(pid=91980) _wait /opt/stack/neutron/neutron/service.py:135}}
Jun 01 12:26:28.826390 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Started child 91981 {{(pid=91839) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
Jun 01 12:26:28.827148 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG neutron_lib.callbacks.manager [None req-ed01c98a-6397-4651-9858-137dfd9bc5ab None None] Notify callbacks [] for process, after_spawn {{(pid=91839) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:28.827255 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:28.827706 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:26:28.829169 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91839) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 12:26:28.829351 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 12:26:28.829538 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 12:26:28.829779 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 12:26:28.830075 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 12:26:28.830261 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 12:26:28.830763 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.831050 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.831320 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.831480 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:28.831957 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.831957 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.832440 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.832919 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.833177 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.833480 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.833710 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.833864 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.834036 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.834278 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.834648 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.834919 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.835089 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.835440 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.835664 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.835871 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.836020 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.836259 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.836486 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.836787 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.837075 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.837541 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.837795 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.838015 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.838242 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.838511 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.838794 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.839060 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.839271 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.839495 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.839686 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.839963 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.840239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.840466 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.840718 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.840980 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.841408 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.841679 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] host                           = dv-cinder-793515-2-iscsi {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.841910 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.842141 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.842400 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.842649 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.842875 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.843089 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.843345 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.843578 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.843861 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.844101 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.844321 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.844564 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.845069 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.845069 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.845425 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.845425 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.845883 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.846021 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.846158 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.846307 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.846457 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.846675 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.846828 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.847077 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.847325 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.847620 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.847774 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.847987 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.848201 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.848452 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.848707 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.848966 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.849161 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.849421 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.849663 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.849887 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.850197 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.850338 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.850542 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.850786 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.851015 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.851263 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.851480 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.851689 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.851949 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.852191 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.852437 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.852777 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.853030 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.853218 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.853423 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.853635 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.853894 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.854123 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.854364 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.854627 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.854986 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.855201 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.855918 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.856168 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.856371 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:26:28.856768 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.858171 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.858171 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.858459 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.858591 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.858831 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.859100 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.859868 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.860121 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.861028 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.861324 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.862023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.862271 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.862953 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.863238 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.863487 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.864292 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.864568 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.864843 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.865190 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.865421 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.865729 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.866031 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.866218 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.867342 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.867635 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.871482 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.871482 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.871482 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.871482 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.872904 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.873060 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.873306 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.873586 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.81/identity {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.873875 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.874151 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.874391 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.874625 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.874855 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.875144 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.875333 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.875698 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.875913 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.876257 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.876383 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.876655 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.876903 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.877173 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.877431 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.877691 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.877949 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.878182 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.878400 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.878620 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.878839 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.879063 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.879318 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.879538 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.879790 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.880024 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.880284 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.880540 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.880761 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.880990 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.881230 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.881456 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.881678 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.883054 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.883054 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.883054 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.883054 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.883054 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.883054 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.884273 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.884273 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.884273 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.884273 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.884273 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.884273 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.888555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889817 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889817 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889817 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.889817 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.890116 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.890116 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.890395 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.890644 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.890913 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.891111 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.891364 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.891594 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.891820 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.892098 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.892844 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.893308 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.893308 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.893816 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.893921 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.894167 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.894441 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.894711 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.894972 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.895250 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.895514 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.895759 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.896051 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.896306 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.896607 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.896919 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.897193 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.897464 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.897720 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.897976 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.898231 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.898467 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.898721 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.898954 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.899215 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.899461 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.899742 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.899982 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.900203 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.900443 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.900720 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.901030 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.901282 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.901499 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.901721 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.902001 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.902563 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.902819 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.903112 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.903409 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.903661 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.904096 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.904363 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.81/identity {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.904616 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.904846 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.905100 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.905314 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.905704 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.906123 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.906551 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.906969 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.907375 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.907818 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.908212 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.908646 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.909066 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.909454 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.909832 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.910228 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.910590 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.910984 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.911235 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.911468 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.911693 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.911943 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.912165 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.912443 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.912694 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.912970 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.913227 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.913484 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.913738 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.913977 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.914248 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.914470 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.914719 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.914942 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.915159 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.915373 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.915614 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.915829 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.916076 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.916324 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.916558 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.916791 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.917014 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.917357 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.917607 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.917839 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.918076 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.918294 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.918532 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.918827 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.919026 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.919265 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.919488 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.919707 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.919968 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.920218 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.920440 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.920704 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.920947 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.921175 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.921392 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.921607 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.921896 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.922141 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.922399 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.922640 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.922869 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.923120 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.923333 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.923547 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.923766 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.924003 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.924229 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.924439 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.924672 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.924898 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.925109 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.925368 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.925672 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.925850 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.926058 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.926271 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.926512 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.926722 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.926933 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.927149 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.927366 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.927702 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.927954 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.928179 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.928476 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.928763 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.929015 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.929278 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.929606 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.929844 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.930083 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.930304 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.930555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.930768 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.931023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.931336 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.931643 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.931910 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.932181 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.932449 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.932764 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:750:799'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.933045 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.933262 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.933571 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.933914 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.934201 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.934989 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.935235 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.935508 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.935731 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.935947 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.936166 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.936412 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.936668 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.936910 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.937150 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.937447 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.937739 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.937971 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.938215 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.938464 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.938701 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.938925 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.939166 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.939325 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 12:26:28.939904 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91839) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
Jun 01 12:26:28.940058 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Jun 01 12:26:28.940199 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Jun 01 12:26:28.940407 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Jun 01 12:26:28.940628 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Jun 01 12:26:28.940768 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Jun 01 12:26:28.940963 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.941165 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.941286 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.941447 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.941607 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.941812 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.941952 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.942113 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.942274 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.942435 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.942597 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.942762 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.942920 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.943079 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.943241 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.943400 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.943560 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.943722 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.943888 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.944050 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.944210 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.944376 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.944550 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.944714 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.944903 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.945067 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.945209 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.945364 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.945523 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.945716 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.945847 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.945993 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.946153 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.946314 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.946475 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.946635 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.946795 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.946954 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.947116 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.947277 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.947550 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] host                           = dv-cinder-793515-2-iscsi {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.947653 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.947841 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.947971 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.948118 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.948544 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.948544 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.948544 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.948926 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.948926 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.949257 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.949257 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.949257 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.949635 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.949635 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.949780 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.949859 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.950000 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.950221 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.950900 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.951118 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.951221 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.951421 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.951548 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.951663 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.951826 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.951987 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.952147 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.952307 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.952469 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.952651 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.952812 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.952973 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.953133 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.953294 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.953453 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.953614 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.953774 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.953937 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.954096 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.954256 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.954416 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.954576 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.954735 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.954895 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.955057 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.955284 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.955451 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.955623 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.955770 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.955931 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.956091 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.956252 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.956417 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.956701 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.956842 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.956954 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.957040 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.957204 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.957363 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.957522 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.957937 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.958096 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.958256 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.958415 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.958576 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.958736 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.958895 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.959056 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.959311 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Jun 01 12:26:28.959503 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.959713 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.959837 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.959940 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:26:28.960041 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.960151 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.960314 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.960476 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.960664 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.960825 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.960988 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.961160 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.961323 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.961501 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.961664 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.961825 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.961991 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.962153 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.962314 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.962477 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.962639 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.962801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.962964 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.963142 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.963305 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.963469 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.81/identity {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.963632 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.963797 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.963961 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.964169 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.964834 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.965009 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.965180 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.965474 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.965788 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.966087 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.966573 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.966783 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.966871 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.967169 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.967461 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.967637 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.967790 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.968024 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.968131 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.968280 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.968444 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.968634 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.968840 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.968985 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.969128 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.969281 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.969446 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.969610 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.969834 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.970004 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.970173 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.970336 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.970500 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.970665 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.970810 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.970978 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.971156 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.971316 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.971454 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.971679 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.971833 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.971971 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.972107 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.972244 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.972380 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.973801 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975084 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975626 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975626 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975626 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975626 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975911 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.975911 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.976062 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.976173 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.976370 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.976475 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.976668 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.976836 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.977000 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.977167 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.977331 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.977528 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.977711 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.977887 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.978039 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.978333 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.978582 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.978747 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.978912 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.979080 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.979241 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.979414 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.979582 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.979753 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.979940 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.980088 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.980264 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.980426 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.980610 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.980775 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.980937 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.981102 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.981271 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.981454 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.981620 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.981785 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.981947 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.982120 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.982293 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.982456 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.982619 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.982780 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.982965 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.983128 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.983289 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.983452 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.983614 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.983777 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.983940 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.984103 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.984266 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.984429 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.984613 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.984778 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.81/identity {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.984942 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.985143 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.985357 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.985453 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.985572 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.985736 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.985898 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.986062 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.986226 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.986389 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.986553 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.986716 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.986879 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.987044 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.987206 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.987369 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.987532 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.987695 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.987858 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.988020 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.988183 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.988349 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.988548 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.988693 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.988856 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.989023 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.989186 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.989357 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.989519 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.989682 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.989845 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.990010 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.990176 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.990340 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.990505 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.990667 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.990831 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.991067 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.991233 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.991363 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.991495 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.991627 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.991758 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.991924 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.992090 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.992250 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.992415 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.992615 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.992779 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.992935 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.993092 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.993254 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.993416 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.993578 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.993744 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.993911 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.994075 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.994239 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.994406 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.994567 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.994730 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.994893 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.995068 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.995230 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.995393 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.995555 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.995717 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.995890 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.996052 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.996215 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.996377 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.996558 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.996736 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.996894 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.997586 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.997735 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.997896 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.998067 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.998254 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.998411 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.998541 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.998688 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.998858 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.999251 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.999251 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.999677 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.999677 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:28.999677 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000044 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000044 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000314 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000314 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000678 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000678 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000927 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.000927 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.001178 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.001178 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.001428 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.001560 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.001699 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.001841 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.001971 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.002109 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.002276 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.002449 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.002622 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:750:799'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.002795 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.002959 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.003129 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.003304 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.003468 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.003631 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.003777 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.003969 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.004103 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.004266 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.004395 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.004598 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.004740 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.004875 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.005026 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.005175 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.005459 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.005744 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.005919 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.006088 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.006274 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.006438 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.006601 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Jun 01 12:26:29.006759 dv-cinder-793515-2-iscsi neutron-server[91839]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Jun 01 12:26:29.069312 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 52394) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:26:29.078422 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [-] 10.222.0.81 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0069821
Jun 01 12:26:39.940837 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd1c55ac-db86-4b88-b8cd-bc1c9a6dac1f None None] get_active_networks_info from dv-cinder-793515-2-iscsi {{(pid=91980) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
Jun 01 12:26:40.020530 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-201e0e2d-ca6b-471c-8045-2c10d8cba4b2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510'] for agent, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:40.030342 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd1c55ac-db86-4b88-b8cd-bc1c9a6dac1f None None] No non-hosted networks {{(pid=91980) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
Jun 01 12:26:42.299647 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510'] for agent, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:42.302315 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.303583 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.304479 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.305415 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.305888 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.306367 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.307053 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.307691 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.309164 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.326481 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.327431 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.328448 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:42.329170 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f7a26955d60>, 'Open vSwitch agent', 'dv-cinder-793515-2-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:26:42.344575 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f7a26963b80>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-793515-2-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:26:42.630150 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-648fc802-9ac6-4365-9c7d-f03e1e9e65b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510'] for agent, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:42.690630 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c66e2bbb-7da3-49b0-922b-1f94340198d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:43.875920 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510'] for agent, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:45.065849 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.db.l3_hamode_db [None req-30aa2eff-cbc3-4bad-990d-57a190db3c48 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
Jun 01 12:26:45.161553 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30aa2eff-cbc3-4bad-990d-57a190db3c48 None None] Routers set() bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:26:45.162008 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30aa2eff-cbc3-4bad-990d-57a190db3c48 None None] Router IDs set() for agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
Jun 01 12:26:45.369129 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510'] for agent, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:46.795527 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 52484) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:26:47.384579 dv-cinder-793515-2-iscsi neutron-server[91979]: WARNING oslo_policy.policy [None req-afc2e9ca-2e41-4ac9-97e4-7655a027749e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:47.385144 dv-cinder-793515-2-iscsi neutron-server[91979]: WARNING oslo_policy.policy [None req-afc2e9ca-2e41-4ac9-97e4-7655a027749e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:47.601885 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [None req-afc2e9ca-2e41-4ac9-97e4-7655a027749e admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91979) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:26:47.602958 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-afc2e9ca-2e41-4ac9-97e4-7655a027749e admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8065157
Jun 01 12:26:49.942370 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 52498) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:26:50.311431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] Request body: {'subnetpool': {'is_default': True, 'name': 'shared-default-subnetpool-v4', 'shared': True, 'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:26:50.409112 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.policy [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91979) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 12:26:50.454436 dv-cinder-793515-2-iscsi neutron-server[91979]: WARNING oslo_policy.policy [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:50.454789 dv-cinder-793515-2-iscsi neutron-server[91979]: WARNING oslo_policy.policy [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:50.463402 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.quota [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f7a2677ec10>.
Jun 01 12:26:50.479108 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:26:50.536139 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8760160951821', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8760160951406', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8760160969292', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8760160968696', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8760161051763', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8760161049297', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-606856', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-649482', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1647924', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1623521'] for rbac-policy, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:50.598782 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:50.600026 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-d94fff06-d3d3-4ae1-9e74-269d712b8b81 admin admin] 10.222.0.81 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.6566339
Jun 01 12:26:53.169699 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52512) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:26:53.753381 dv-cinder-793515-2-iscsi neutron-server[91978]: WARNING oslo_policy.policy [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:53.753951 dv-cinder-793515-2-iscsi neutron-server[91978]: WARNING oslo_policy.policy [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:53.969085 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Request body: {'network': {'admin_state_up': True, 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'name': 'private'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:26:53.970734 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.quota [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f7a26996af0>.
Jun 01 12:26:53.986758 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:26:53.993212 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Usage tracker for resource:network and tenant:b7cfd0cc3f944023af52a7bb974ae076 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:26:53.999298 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:26:54.007133 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:26:54.023127 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Made reservation on behalf of b7cfd0cc3f944023af52a7bb974ae076 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:26:54.094081 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.policy [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91978) register_rules /opt/stack/neutron/neutron/policy.py:73}}
Jun 01 12:26:54.141459 dv-cinder-793515-2-iscsi neutron-server[91978]: WARNING oslo_policy.policy [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:54.141835 dv-cinder-793515-2-iscsi neutron-server[91978]: WARNING oslo_policy.policy [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
Jun 01 12:26:54.151701 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.172660 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.187507 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:26:54.191186 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Usage tracker for resource:security_group_rule and tenant:b7cfd0cc3f944023af52a7bb974ae076 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:26:54.196505 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:26:54.202283 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:26:54.304421 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.308079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.313618 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:26:54.334023 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] vlan segment allocate from pool success with {'vlan_id': 794, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:26:54.359818 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8760163830501', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.360407 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f7a2740ae50> segment precommit_create {{(pid=91978) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 12:26:54.360887 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Added segment ba9dbb1e-c025-4cf5-bb99-71a1472f5644 of type vlan for network be63f888-918a-45e2-a3f8-f15ceb75d42f
Jun 01 12:26:54.369184 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97ca08f8-2eea-41d5-9162-c5ad40224e11,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:26:54.431123 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.431710 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.432173 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.432482 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.432812 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.433130 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.433533 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.433838 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.434191 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.434496 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.434795 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.435090 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Tracked resource versions report:
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]: pushed versions:
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]: {   'AddressGroup': {'1.2'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'ConntrackHelper': {'1.0'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Log': {'1.0'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Network': {'1.1'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Port': {'1.7'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'PortForwarding': {'1.2'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'QosPolicy': {'1.8'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'SecurityGroup': {'1.4'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'SubPort': {'1.0'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Subnet': {'1.1'},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Trunk': {'1.1'}}
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]: consumer versions:
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Log': '1.0',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Network': '1.1',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Port': '1.7',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'PortForwarding': '1.2',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'QosPolicy': '1.8',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'SecurityGroup': '1.4',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'SubPort': '1.0',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Subnet': '1.1',
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Trunk': '1.1'}}
Jun 01 12:26:54.436135 dv-cinder-793515-2-iscsi neutron-server[91978]:  {{(pid=91978) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:26:54.472690 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:26:54.493628 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.532437 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.533984 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:26:54.534614 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:54.539088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:26:54.643700 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.4717913
Jun 01 12:26:54.644300 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Pushing event updated for resources: {'Network': ['ID=be63f888-918a-45e2-a3f8-f15ceb75d42f,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:26:54.648402 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:26:54.668024 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network be63f888-918a-45e2-a3f8-f15ceb75d42f details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:26:57.353875 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52534) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:26:57.801043 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ac1cfcb-6e8c-454f-aa89-dda79338fcb4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:26:57.802405 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0ac1cfcb-6e8c-454f-aa89-dda79338fcb4 admin admin] 10.222.0.81 "GET /v2.0/networks/be63f888-918a-45e2-a3f8-f15ceb75d42f HTTP/1.1" status: 200  len: 825 time: 0.4475653
Jun 01 12:26:57.832071 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-4771b639-99b7-4f43-86e0-efcab56e777e admin admin] 10.222.0.81 "GET /v2.0/subnetpools/2b9664ba-72b0-4e7d-ac87-874dc2551d97 HTTP/1.1" status: 200  len: 734 time: 0.0243595
Jun 01 12:26:57.841155 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'ip_version': 4, 'subnetpool_id': '2b9664ba-72b0-4e7d-ac87-874dc2551d97', 'gateway_ip': '172.20.0.1', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:26:57.845829 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:26:57.849610 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Usage tracker for resource:subnet and tenant:b7cfd0cc3f944023af52a7bb974ae076 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:26:57.852611 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:26:57.859877 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:26:57.869296 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Made reservation on behalf of b7cfd0cc3f944023af52a7bb974ae076 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:26:57.871663 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:58.346040 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:58.351021 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:26:58.426405 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2beaec64-809a-4898-9fbd-86950371b4e0,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:26:58.429492 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:26:58.432088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Checking segment: {'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:26:58.432471 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Network hostable DHCP agents. Network: be63f888-918a-45e2-a3f8-f15ceb75d42f, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:26:58.450937 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Network be63f888-918a-45e2-a3f8-f15ceb75d42f is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:26:58.460791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, be63f888-918a-45e2-a3f8-f15ceb75d42f) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:26:58.465988 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:26:58.466588 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:58.470640 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c9318b4-faaa-4432-958c-39712e739c17 None None] Network be63f888-918a-45e2-a3f8-f15ceb75d42f requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:26:58.487397 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.6496606
Jun 01 12:26:58.776655 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-be63f888-918a-45e2-a3f8-f15ceb75d42f', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'fixed_ips': [{'subnet_id': '2beaec64-809a-4898-9fbd-86950371b4e0'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:26:58.777955 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:58.964877 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Allocated IP 172.20.0.2 (be63f888-918a-45e2-a3f8-f15ceb75d42f/2beaec64-809a-4898-9fbd-86950371b4e0/88447e80-ccad-4116-955d-d99388b5604c) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:26:59.193704 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:59.206750 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Transition to ACTIVE for port object 88447e80-ccad-4116-955d-d99388b5604c will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:26:59.227453 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Transition to ACTIVE for port object 88447e80-ccad-4116-955d-d99388b5604c will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:26:59.234919 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:59.240680 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:26:59.299388 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Network be63f888-918a-45e2-a3f8-f15ceb75d42f is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:26:59.302141 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:26:59.308010 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:26:59.315059 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Pushing event updated for resources: {'Port': ['ID=88447e80-ccad-4116-955d-d99388b5604c,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:26:59.354471 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.354801 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.355129 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.355453 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.355770 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.356630 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.359653 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.359653 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.359653 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.359653 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.359653 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Tracked resource versions report:
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]: pushed versions:
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]: {   'AddressGroup': {'1.2'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'ConntrackHelper': {'1.0'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Log': {'1.0'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Network': {'1.1'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Port': {'1.7'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'PortForwarding': {'1.2'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'QosPolicy': {'1.8'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'SecurityGroup': {'1.4'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'SubPort': {'1.0'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Subnet': {'1.1'},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Trunk': {'1.1'}}
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]: consumer versions:
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Log': '1.0',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Network': '1.1',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Port': '1.7',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'PortForwarding': '1.2',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'QosPolicy': '1.8',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'SecurityGroup': '1.4',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'SubPort': '1.0',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Subnet': '1.1',
Jun 01 12:26:59.360137 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Trunk': '1.1'}}
Jun 01 12:26:59.363105 dv-cinder-793515-2-iscsi neutron-server[91980]:  {{(pid=91980) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:26:59.391353 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:26:59.416205 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Attempting to bind port 88447e80-ccad-4116-955d-d99388b5604c on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:26:59.416621 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Attempting to bind port 88447e80-ccad-4116-955d-d99388b5604c by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:26:59.417056 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Attempting to bind port 88447e80-ccad-4116-955d-d99388b5604c on network be63f888-918a-45e2-a3f8-f15ceb75d42f {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:26:59.423089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 26, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:26:59.423530 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Checking segment: {'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:26:59.423991 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:59.424377 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Bound using segment: {'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:26:59.424949 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Bound port: 88447e80-ccad-4116-955d-d99388b5604c, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:26:59.425434 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:59.518716 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] For port 88447e80-ccad-4116-955d-d99388b5604c, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:26:59.522446 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] For port 88447e80-ccad-4116-955d-d99388b5604c, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=88447e80-ccad-4116-955d-d99388b5604c,segment=NetworkSegment(ba9dbb1e-c025-4cf5-bb99-71a1472f5644),segment_id=ba9dbb1e-c025-4cf5-bb99-71a1472f5644)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:26:59.528205 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:26:59.532025 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:26:59.618007 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Pushing event updated for resources: {'Port': ['ID=88447e80-ccad-4116-955d-d99388b5604c,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:26:59.621099 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:00.916720 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52544) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:01.295725 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [None req-97d2d710-5ea0-4768-b392-84c484aba27e admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91978) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:27:01.296804 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-97d2d710-5ea0-4768-b392-84c484aba27e admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3793197
Jun 01 12:27:03.666750 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52554) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:04.060159 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [None req-657cf26f-eb24-4524-bd59-27b5f2e27632 admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91978) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:27:04.061300 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-657cf26f-eb24-4524-bd59-27b5f2e27632 admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3935957
Jun 01 12:27:04.915901 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 88447e80-ccad-4116-955d-d99388b5604c up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:27:04.989297 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 88447e80-ccad-4116-955d-d99388b5604c completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:27:05.108972 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53580286-9ecb-4765-8bf7-abf04b6f697b None None] Network be63f888-918a-45e2-a3f8-f15ceb75d42f requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:27:05.187740 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Provisioning for port 88447e80-ccad-4116-955d-d99388b5604c completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:27:05.202284 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Provisioning complete for port 88447e80-ccad-4116-955d-d99388b5604c triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:05.202687 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:05.400186 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:05.478619 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] For port 88447e80-ccad-4116-955d-d99388b5604c, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=88447e80-ccad-4116-955d-d99388b5604c,segment=NetworkSegment(ba9dbb1e-c025-4cf5-bb99-71a1472f5644),segment_id=ba9dbb1e-c025-4cf5-bb99-71a1472f5644)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:27:05.483221 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:05.488454 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:05.588193 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Pushing event updated for resources: {'Port': ['ID=88447e80-ccad-4116-955d-d99388b5604c,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:05.592039 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:05.807152 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-91611a40-b0b4-4674-8deb-6f1b0d08365b None None] Provisioning complete for port 88447e80-ccad-4116-955d-d99388b5604c triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:05.807514 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-91611a40-b0b4-4674-8deb-6f1b0d08365b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:06.689876 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52570) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:06.871308 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 88447e80-ccad-4116-955d-d99388b5604c up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:27:06.937865 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 88447e80-ccad-4116-955d-d99388b5604c triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:06.938243 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:07.055653 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'name': 'router1'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:27:07.062175 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:27:07.066079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Usage tracker for resource:router and tenant:b7cfd0cc3f944023af52a7bb974ae076 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:27:07.069673 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:27:07.075379 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:27:07.086144 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:07.088729 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:07.111960 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:07.223521 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:07.242322 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:07.243622 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-fcd21030-5030-499a-86a1-f5066ce6b7e3 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.5527935
Jun 01 12:27:09.567746 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52580) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:09.773816 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1648e02f-2c19-44aa-b0a5-c7d6c3476b23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:09.935193 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [None req-aa60419c-6694-4377-b658-73ed0c49e398 admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91978) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:27:09.936195 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-aa60419c-6694-4377-b658-73ed0c49e398 admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3675017
Jun 01 12:27:12.258109 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52590) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:12.297050 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.624845 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ce906ecb-2fb1-457c-ac2a-2d91844e6588 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.628229 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'router:external': True, 'provider:network_type': 'flat', 'admin_state_up': True, 'is_default': True, 'name': 'public'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:27:12.648330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:27:12.652200 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Usage tracker for resource:network and tenant:376dc29840f4476ba0a86b99827e33e1 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:27:12.655059 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:27:12.660738 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:27:12.670653 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Made reservation on behalf of 376dc29840f4476ba0a86b99827e33e1 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:27:12.673074 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.685402 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.699105 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:27:12.702952 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Usage tracker for resource:security_group_rule and tenant:376dc29840f4476ba0a86b99827e33e1 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:27:12.705712 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:27:12.712082 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:27:12.794085 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.798137 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.802064 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:12.828136 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Reserving flat network on physical network physnet1 {{(pid=91978) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
Jun 01 12:27:12.843121 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dbe63a1-bd35-45f9-8dae-fd94f8bc5dda,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:12.847012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:12.851683 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.852060 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Added segment e393528e-e6c5-4c07-9e73-e139b99685c7 of type flat for network 44ed28c8-c80a-4954-a823-abbd3f7966bf
Jun 01 12:27:12.884570 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.919164 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.920574 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:27:12.921139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:12.925446 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:13.019956 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.7607541
Jun 01 12:27:13.022973 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Pushing event updated for resources: {'Network': ['ID=44ed28c8-c80a-4954-a823-abbd3f7966bf,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:13.026178 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:13.033690 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:27:13.789601 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:15.310574 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:15.356638 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52610) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:15.566382 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ad6f048-e5e8-4ec8-a761-6fcf0413483f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:27:15.567693 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0ad6f048-e5e8-4ec8-a761-6fcf0413483f admin admin] 10.222.0.81 "GET /v2.0/subnets/2beaec64-809a-4898-9fbd-86950371b4e0 HTTP/1.1" status: 200  len: 849 time: 0.2101228
Jun 01 12:27:15.709807 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-c1717053-9d54-45bd-beb3-621af9c96fe2 admin admin] 10.222.0.81 "GET /v2.0/routers/c76bdf0c-735a-4fee-84b9-bc4c6678bb02 HTTP/1.1" status: 200  len: 704 time: 0.1367064
Jun 01 12:27:16.170947 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:16.394930 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Allocated IP 172.20.0.1 (be63f888-918a-45e2-a3f8-f15ceb75d42f/2beaec64-809a-4898-9fbd-86950371b4e0/688136a2-eb05-4d8a-b7a9-2540386fb8ed) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:27:16.548868 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:16.566167 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.provisioning_blocks [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Transition to ACTIVE for port object 688136a2-eb05-4d8a-b7a9-2540386fb8ed will not be triggered until provisioned by entity DHCP. {{(pid=91978) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:27:16.656558 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:16.660314 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:16.725381 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Network be63f888-918a-45e2-a3f8-f15ceb75d42f is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:27:16.728186 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:27:16.731860 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:27:16.732353 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:16.849445 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Pushing event updated for resources: {'Port': ['ID=688136a2-eb05-4d8a-b7a9-2540386fb8ed,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:16.864230 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:16.911113 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-9a1ceafc-b5db-4910-802a-c89347bb14d8 None None] Provisioning for port 688136a2-eb05-4d8a-b7a9-2540386fb8ed completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:27:16.915600 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-9a1ceafc-b5db-4910-802a-c89347bb14d8 None None] Provisioning complete for port 688136a2-eb05-4d8a-b7a9-2540386fb8ed triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:16.915967 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9a1ceafc-b5db-4910-802a-c89347bb14d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:16.968838 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-9a1ceafc-b5db-4910-802a-c89347bb14d8 None None] Port 688136a2-eb05-4d8a-b7a9-2540386fb8ed cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:27:16.998230 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:17.223232 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:17.227566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:17.228893 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:17.232536 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:17.358806 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Pushing event updated for resources: {'Port': ['ID=688136a2-eb05-4d8a-b7a9-2540386fb8ed,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:17.365263 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:17.424504 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Network be63f888-918a-45e2-a3f8-f15ceb75d42f is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:27:17.425590 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:27:17.592173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-273e28d5-a615-4a4c-879e-2267d7179368 None None] Provisioning complete for port 688136a2-eb05-4d8a-b7a9-2540386fb8ed triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:17.592559 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-273e28d5-a615-4a4c-879e-2267d7179368 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:17.613834 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91978) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:27:17.646152 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-273e28d5-a615-4a4c-879e-2267d7179368 None None] Port 688136a2-eb05-4d8a-b7a9-2540386fb8ed cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:27:17.778828 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:27:17.788111 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] 10.222.0.81 "PUT /v2.0/routers/c76bdf0c-735a-4fee-84b9-bc4c6678bb02/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.0733857
Jun 01 12:27:17.788900 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Sync routers for ids ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:27:17.801403 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Routers {'c76bdf0c-735a-4fee-84b9-bc4c6678bb02'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:27:17.802277 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2693b970>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:27:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:17.984371 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Set router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 gateway port host: None {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:27:18.358660 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2693b970>, [{'id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'name': 'router1', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:27:07Z', 'updated_at': '2021-06-01T12:27:16Z', 'revision_number': 2, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'gw_port_host': None, '_interfaces': [{'id': '688136a2-eb05-4d8a-b7a9-2540386fb8ed', 'name': '', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'mac_address': 'fa:16:3e:c6:1e:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:16Z', 'updated_at': '2021-06-01T12:27:17Z', 'revision_number': 2, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'subnets': [{'id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2b9664ba-72b0-4e7d-ac87-874dc2551d97'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:18.363640 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Checking router: c76bdf0c-735a-4fee-84b9-bc4c6678bb02 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:27:18.363999 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Updating router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 port 688136a2-eb05-4d8a-b7a9-2540386fb8ed binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:27:18.419905 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:18.806367 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:18.822731 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Transition to ACTIVE for port object 688136a2-eb05-4d8a-b7a9-2540386fb8ed will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:27:18.830494 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:18.836213 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:19.041926 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Pushing event updated for resources: {'Port': ['ID=688136a2-eb05-4d8a-b7a9-2540386fb8ed,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:19.060274 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.060498 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.060850 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.061170 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.061487 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.061878 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.062098 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.062398 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.062730 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.063040 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.063344 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.063647 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Tracked resource versions report:
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]: pushed versions:
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]: {   'AddressGroup': {'1.2'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'ConntrackHelper': {'1.0'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Log': {'1.0'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Network': {'1.1'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Port': {'1.7'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'PortForwarding': {'1.2'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'QosPolicy': {'1.8'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'SecurityGroup': {'1.4'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'SubPort': {'1.0'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Subnet': {'1.1'},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Trunk': {'1.1'}}
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]: consumer versions:
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Log': '1.0',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Network': '1.1',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Port': '1.7',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'PortForwarding': '1.2',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'QosPolicy': '1.8',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'SecurityGroup': '1.4',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'SubPort': '1.0',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Subnet': '1.1',
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Trunk': '1.1'}}
Jun 01 12:27:19.064740 dv-cinder-793515-2-iscsi neutron-server[91981]:  {{(pid=91981) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:27:19.079026 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:19.083796 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Attempting to bind port 688136a2-eb05-4d8a-b7a9-2540386fb8ed on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:27:19.084166 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Attempting to bind port 688136a2-eb05-4d8a-b7a9-2540386fb8ed by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:27:19.084504 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Attempting to bind port 688136a2-eb05-4d8a-b7a9-2540386fb8ed on network be63f888-918a-45e2-a3f8-f15ceb75d42f {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:27:19.090505 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:27:19.090906 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Checking segment: {'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:27:19.091377 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:19.091768 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Bound using segment: {'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:27:19.092293 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Bound port: 688136a2-eb05-4d8a-b7a9-2540386fb8ed, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ba9dbb1e-c025-4cf5-bb99-71a1472f5644', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 794, 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:27:19.092707 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:19.182631 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] For port 688136a2-eb05-4d8a-b7a9-2540386fb8ed, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:27:19.186660 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] For port 688136a2-eb05-4d8a-b7a9-2540386fb8ed, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=688136a2-eb05-4d8a-b7a9-2540386fb8ed,segment=NetworkSegment(ba9dbb1e-c025-4cf5-bb99-71a1472f5644),segment_id=ba9dbb1e-c025-4cf5-bb99-71a1472f5644)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:27:19.192322 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:19.197713 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:19.279998 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Pushing event updated for resources: {'Port': ['ID=688136a2-eb05-4d8a-b7a9-2540386fb8ed,revision_number=4']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:19.303607 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Routers {'c76bdf0c-735a-4fee-84b9-bc4c6678bb02'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:27:19.304227 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2693b970>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:27:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:19.446110 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-5798cfa9-c8fb-4f62-bb75-5b5402c88973 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:19.487606 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] Set router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 gateway port host: None {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:27:19.819268 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2693b970>, [{'id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'name': 'router1', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:27:07Z', 'updated_at': '2021-06-01T12:27:16Z', 'revision_number': 2, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'gw_port_host': None, '_interfaces': [{'id': '688136a2-eb05-4d8a-b7a9-2540386fb8ed', 'name': '', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'mac_address': 'fa:16:3e:c6:1e:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:16Z', 'updated_at': '2021-06-01T12:27:19Z', 'revision_number': 4, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'subnets': [{'id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2b9664ba-72b0-4e7d-ac87-874dc2551d97'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:19.823188 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa285db9-2c66-471f-8228-5f144cf7f91a None None] The sync data for ids ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'] in dv-cinder-793515-2-iscsi is: [{'id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'name': 'router1', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:27:07Z', 'updated_at': '2021-06-01T12:27:16Z', 'revision_number': 2, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'gw_port_host': None, '_interfaces': [{'id': '688136a2-eb05-4d8a-b7a9-2540386fb8ed', 'name': '', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'mac_address': 'fa:16:3e:c6:1e:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:16Z', 'updated_at': '2021-06-01T12:27:19Z', 'revision_number': 4, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'subnets': [{'id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2b9664ba-72b0-4e7d-ac87-874dc2551d97'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:27:19.990724 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52634) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:20.183563 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d588190-070e-4968-97de-7eec72b588e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:27:20.184140 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1d588190-070e-4968-97de-7eec72b588e6 admin admin] Synchronizing usage tracker for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:network {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:27:20.202857 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1d588190-070e-4968-97de-7eec72b588e6 admin admin] Unset dirty status for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:network {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:27:20.203999 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1d588190-070e-4968-97de-7eec72b588e6 admin admin] 10.222.0.81 "GET /v2.0/networks/44ed28c8-c80a-4954-a823-abbd3f7966bf HTTP/1.1" status: 200  len: 842 time: 0.2122571
Jun 01 12:27:20.214056 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.27.3.1', 'enable_dhcp': False, 'name': 'public-subnet', 'cidr': '172.27.3.0/24', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:27:20.219973 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:27:20.223800 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Usage tracker for resource:subnet and tenant:376dc29840f4476ba0a86b99827e33e1 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:27:20.226612 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:27:20.232579 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:27:20.241298 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Made reservation on behalf of 376dc29840f4476ba0a86b99827e33e1 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:27:20.243718 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:20.656360 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.objects.ports [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=91978) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
Jun 01 12:27:20.656815 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:20.661216 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0d96eadf-3ea2-4e29-81e0-3209cd3fb705 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:20.732133 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=84d66640-a99d-4108-a81c-3480c5626219,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:20.736366 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:20.737220 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:27:20.737566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Network hostable DHCP agents. Network: 44ed28c8-c80a-4954-a823-abbd3f7966bf, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:27:20.754913 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:27:20.764316 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 44ed28c8-c80a-4954-a823-abbd3f7966bf) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:27:20.768625 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:27:20.769203 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:20.775190 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c3bd0ae-027f-4e97-8aa3-75fd548f183e None None] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:27:20.798845 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.5782168
Jun 01 12:27:20.994433 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a2a09de9-caf6-474c-8d10-2bedff757e12 None None] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:27:22.914875 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 688136a2-eb05-4d8a-b7a9-2540386fb8ed up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:27:22.989782 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 688136a2-eb05-4d8a-b7a9-2540386fb8ed completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:27:22.997048 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 688136a2-eb05-4d8a-b7a9-2540386fb8ed triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:22.997423 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:23.031844 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52648) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:23.115635 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:23.148495 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 688136a2-eb05-4d8a-b7a9-2540386fb8ed, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=688136a2-eb05-4d8a-b7a9-2540386fb8ed,segment=NetworkSegment(ba9dbb1e-c025-4cf5-bb99-71a1472f5644),segment_id=ba9dbb1e-c025-4cf5-bb99-71a1472f5644)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:27:23.152817 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:23.156019 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:23.224271 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=688136a2-eb05-4d8a-b7a9-2540386fb8ed,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:23.228562 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:23.228751 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a7772063-d823-4c39-a49b-57c863432f23 admin admin] 10.222.0.81 "GET /v2.0/routers/c76bdf0c-735a-4fee-84b9-bc4c6678bb02 HTTP/1.1" status: 200  len: 710 time: 0.1951227
Jun 01 12:27:23.359311 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb5a34a8-dc68-46b1-abba-f114ddf4baed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:27:23.360765 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bb5a34a8-dc68-46b1-abba-f114ddf4baed admin admin] 10.222.0.81 "GET /v2.0/networks/44ed28c8-c80a-4954-a823-abbd3f7966bf HTTP/1.1" status: 200  len: 886 time: 0.1263990
Jun 01 12:27:23.369367 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:27:23.860800 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:24.175956 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:24.233857 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:24.364413 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Allocated IP 172.27.3.220 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/e7e9037a-6dad-4942-a5ec-9aeb9524677c) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:27:24.506939 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:24.535857 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:24.540475 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b5baadee-9274-4b69-8044-81ead2a8ec82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:24.596541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:27:24.599199 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:27:24.603015 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:27:24.713460 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Pushing event updated for resources: {'Port': ['ID=e7e9037a-6dad-4942-a5ec-9aeb9524677c,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:24.722117 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:24.895240 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 688136a2-eb05-4d8a-b7a9-2540386fb8ed up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:27:24.962633 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 688136a2-eb05-4d8a-b7a9-2540386fb8ed triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:24.963007 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:24.986348 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:25.375015 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:25.378246 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1981319', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1981382', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1978706'] for router, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:25.551285 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:27:25.729191 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:27:25.737743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:25.738914 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] 10.222.0.81 "PUT /v2.0/routers/c76bdf0c-735a-4fee-84b9-bc4c6678bb02 HTTP/1.1" status: 200  len: 890 time: 2.3728130
Jun 01 12:27:25.739533 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Sync routers for ids ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:27:25.749702 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Routers {'c76bdf0c-735a-4fee-84b9-bc4c6678bb02'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:27:25.750352 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a27cb2100>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:27:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:25.964103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Set router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:27:26.298105 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a27cb2100>, [{'id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'name': 'router1', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'e7e9037a-6dad-4942-a5ec-9aeb9524677c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:27:07Z', 'updated_at': '2021-06-01T12:27:24Z', 'revision_number': 4, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'gw_port': {'id': 'e7e9037a-6dad-4942-a5ec-9aeb9524677c', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:b0:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:24Z', 'updated_at': '2021-06-01T12:27:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '688136a2-eb05-4d8a-b7a9-2540386fb8ed', 'name': '', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'mac_address': 'fa:16:3e:c6:1e:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:16Z', 'updated_at': '2021-06-01T12:27:23Z', 'revision_number': 5, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'subnets': [{'id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2b9664ba-72b0-4e7d-ac87-874dc2551d97'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:26.303092 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Checking router: c76bdf0c-735a-4fee-84b9-bc4c6678bb02 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:27:26.303438 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Updating router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 port e7e9037a-6dad-4942-a5ec-9aeb9524677c binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:27:26.355041 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:26.684925 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:26.696779 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Transition to ACTIVE for port object e7e9037a-6dad-4942-a5ec-9aeb9524677c will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:27:26.703932 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:26.708067 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-1f55a7c6-2689-400e-8a2a-97a4ed1fdf01 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:26.785311 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Attempting to bind port e7e9037a-6dad-4942-a5ec-9aeb9524677c on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:27:26.785675 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Attempting to bind port e7e9037a-6dad-4942-a5ec-9aeb9524677c by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:27:26.786026 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Attempting to bind port e7e9037a-6dad-4942-a5ec-9aeb9524677c on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:27:26.789298 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5fcfe8b-4fea-46e9-af0f-994864118677 None None] Pushing event updated for resources: {'Port': ['ID=e7e9037a-6dad-4942-a5ec-9aeb9524677c,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:26.793064 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e5fcfe8b-4fea-46e9-af0f-994864118677 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:26.793931 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:27:26.794337 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:27:26.794718 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:26.795089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:27:26.795686 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Bound port: e7e9037a-6dad-4942-a5ec-9aeb9524677c, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:27:26.796078 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:26.867018 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] For port e7e9037a-6dad-4942-a5ec-9aeb9524677c, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:27:26.870009 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] For port e7e9037a-6dad-4942-a5ec-9aeb9524677c, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=e7e9037a-6dad-4942-a5ec-9aeb9524677c,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:27:26.874539 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:26.878318 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:26.955738 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5fcfe8b-4fea-46e9-af0f-994864118677 None None] Pushing event updated for resources: {'Port': ['ID=e7e9037a-6dad-4942-a5ec-9aeb9524677c,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:26.958435 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Routers {'c76bdf0c-735a-4fee-84b9-bc4c6678bb02'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:27:26.959014 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a27cb2100>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:27:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:27.005261 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e5fcfe8b-4fea-46e9-af0f-994864118677 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:27.136483 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] Set router c76bdf0c-735a-4fee-84b9-bc4c6678bb02 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:27:27.482008 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a27cb2100>, [{'id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'name': 'router1', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'e7e9037a-6dad-4942-a5ec-9aeb9524677c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:27:07Z', 'updated_at': '2021-06-01T12:27:24Z', 'revision_number': 4, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'gw_port': {'id': 'e7e9037a-6dad-4942-a5ec-9aeb9524677c', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:b0:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:24Z', 'updated_at': '2021-06-01T12:27:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '688136a2-eb05-4d8a-b7a9-2540386fb8ed', 'name': '', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'mac_address': 'fa:16:3e:c6:1e:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:16Z', 'updated_at': '2021-06-01T12:27:23Z', 'revision_number': 5, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'subnets': [{'id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2b9664ba-72b0-4e7d-ac87-874dc2551d97'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:27:27.485977 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07a17a7b-b1fc-473c-9be3-62807493ae78 None None] The sync data for ids ['c76bdf0c-735a-4fee-84b9-bc4c6678bb02'] in dv-cinder-793515-2-iscsi is: [{'id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'name': 'router1', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.220'}], 'enable_snat': True}, 'gw_port_id': 'e7e9037a-6dad-4942-a5ec-9aeb9524677c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:27:07Z', 'updated_at': '2021-06-01T12:27:24Z', 'revision_number': 4, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'gw_port': {'id': 'e7e9037a-6dad-4942-a5ec-9aeb9524677c', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:b0:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:24Z', 'updated_at': '2021-06-01T12:27:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '688136a2-eb05-4d8a-b7a9-2540386fb8ed', 'name': '', 'network_id': 'be63f888-918a-45e2-a3f8-f15ceb75d42f', 'tenant_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'mac_address': 'fa:16:3e:c6:1e:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c76bdf0c-735a-4fee-84b9-bc4c6678bb02', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:27:16Z', 'updated_at': '2021-06-01T12:27:23Z', 'revision_number': 5, 'project_id': 'b7cfd0cc3f944023af52a7bb974ae076', 'subnets': [{'id': '2beaec64-809a-4898-9fbd-86950371b4e0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '2b9664ba-72b0-4e7d-ac87-874dc2551d97'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:27:28.067628 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 52658) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:27:28.180777 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2538f3cb-a6fd-41bd-ad20-d4feea2c5f45 admin admin] 10.222.0.81 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1119773
Jun 01 12:27:28.929253 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device e7e9037a-6dad-4942-a5ec-9aeb9524677c up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:27:28.998183 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port e7e9037a-6dad-4942-a5ec-9aeb9524677c completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:27:29.003593 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port e7e9037a-6dad-4942-a5ec-9aeb9524677c triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:29.004104 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:29.128471 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:29.145155 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port e7e9037a-6dad-4942-a5ec-9aeb9524677c, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=e7e9037a-6dad-4942-a5ec-9aeb9524677c,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:27:29.148780 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:29.152015 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:27:29.218697 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=e7e9037a-6dad-4942-a5ec-9aeb9524677c,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:27:29.221774 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:27:30.910215 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device e7e9037a-6dad-4942-a5ec-9aeb9524677c up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:27:30.978240 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port e7e9037a-6dad-4942-a5ec-9aeb9524677c triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:27:30.978609 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:39.778707 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6f175471-d7ae-4a9b-b166-4e0a065928a6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:41.880705 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:27:42.299730 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:42.634831 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1874494f-c24f-46e9-9b69-06b0835e755b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:43.813194 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:27:45.336405 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:09.782733 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-46f3c1e0-cfd1-4878-8a24-56b55175c9cd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:12.302415 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:12.630689 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-4c45e507-a086-4800-be1a-8b36991e534a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:13.794799 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:15.327558 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:18.880912 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:28:39.787689 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2942334c-a0a6-474d-8fa7-ac2c648cf7b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:42.311160 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:42.635312 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9d6239c0-a7ad-49a6-a607-cb942fe7f5b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:43.797258 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:45.333017 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:28:55.881082 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:29:03.566294 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53228) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:03.632430 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.pecan_wsgi.hooks.translation [None req-21a5f535-85b8-4540-af13-5f0967236c8a admin admin] GET failed (client error): The resource could not be found.
Jun 01 12:29:03.633705 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-21a5f535-85b8-4540-af13-5f0967236c8a admin admin] 10.222.0.81 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0664606
Jun 01 12:29:03.762203 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e069d5f9-0bed-4b86-ba6a-4cfa391633ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:03.763578 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e069d5f9-0bed-4b86-ba6a-4cfa391633ba admin admin] 10.222.0.81 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1251905
Jun 01 12:29:05.848079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53238) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:05.956842 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8015f05-1bd8-4b99-becb-c6671b179e6e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:05.957385 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b8015f05-1bd8-4b99-becb-c6671b179e6e admin admin] Synchronizing usage tracker for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:subnet {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:29:05.973516 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b8015f05-1bd8-4b99-becb-c6671b179e6e admin admin] Unset dirty status for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:subnet {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:29:05.974702 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b8015f05-1bd8-4b99-becb-c6671b179e6e admin admin] 10.222.0.81 "GET /v2.0/subnets/2beaec64-809a-4898-9fbd-86950371b4e0 HTTP/1.1" status: 200  len: 849 time: 0.1256030
Jun 01 12:29:05.984494 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:29:06.100368 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Notify callbacks [] for subnet, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:06.288298 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8760163819677'] for subnet, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:06.292740 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:29:06.331227 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:06.332175 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:06.333369 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] 10.222.0.81 "PUT /v2.0/subnets/2beaec64-809a-4898-9fbd-86950371b4e0 HTTP/1.1" status: 200  len: 868 time: 0.3524017
Jun 01 12:29:06.335804 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4d34366-be7b-4403-9221-4134f5358afb None None] Network be63f888-918a-45e2-a3f8-f15ceb75d42f requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:29:06.357988 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2beaec64-809a-4898-9fbd-86950371b4e0,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:29:06.365626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.365997 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.366323 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.366642 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.366963 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.367281 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.367620 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.367940 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.368282 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.368626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.368941 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.369249 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:06.373417 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:29:06.773306 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-98196973-51d8-416a-877f-f99d1c7a9782 None None] Provisioning complete for port 688136a2-eb05-4d8a-b7a9-2540386fb8ed triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:29:06.773669 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-98196973-51d8-416a-877f-f99d1c7a9782 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:06.902450 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-98196973-51d8-416a-877f-f99d1c7a9782 None None] Provisioning complete for port 88447e80-ccad-4116-955d-d99388b5604c triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:29:06.902705 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-98196973-51d8-416a-877f-f99d1c7a9782 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:08.458804 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53248) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:08.632415 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc2fb112-f703-4d97-ac06-69bfad8c3f39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:08.632885 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc2fb112-f703-4d97-ac06-69bfad8c3f39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:08.634422 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-dc2fb112-f703-4d97-ac06-69bfad8c3f39 admin admin] 10.222.0.81 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1746504
Jun 01 12:29:09.789346 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-699e8833-3eae-42c2-bd3c-0fab25c77a68 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:10.787366 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53258) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:10.964293 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b251a03c-2456-4ba3-beca-5e5a47caaa83 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:10.964791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b251a03c-2456-4ba3-beca-5e5a47caaa83 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:10.966293 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b251a03c-2456-4ba3-beca-5e5a47caaa83 admin admin] 10.222.0.81 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1780093
Jun 01 12:29:12.304419 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:12.637121 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ceec028a-c79e-474f-bdef-a4aed645ca75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:13.083060 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53268) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:13.301266 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3fc0a5f-429c-4f60-a044-316ef0bd0213 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:13.302622 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b3fc0a5f-429c-4f60-a044-316ef0bd0213 admin admin] 10.222.0.81 "GET /v2.0/networks/44ed28c8-c80a-4954-a823-abbd3f7966bf HTTP/1.1" status: 200  len: 886 time: 0.2186224
Jun 01 12:29:13.799520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:15.336545 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:15.441512 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53278) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:15.615237 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a5fc62d-288b-4631-ad5d-09c5ed572c67 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:15.616497 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2a5fc62d-288b-4631-ad5d-09c5ed572c67 admin admin] 10.222.0.81 "GET /v2.0/networks/be63f888-918a-45e2-a3f8-f15ceb75d42f HTTP/1.1" status: 200  len: 869 time: 0.1740429
Jun 01 12:29:17.730063 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53288) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:17.838875 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e41f4083-4207-44bd-849d-ce5f267652e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:17.839330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e41f4083-4207-44bd-849d-ce5f267652e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:17.840843 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e41f4083-4207-44bd-849d-ce5f267652e2 admin admin] 10.222.0.81 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1098304
Jun 01 12:29:20.090710 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53298) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:20.199354 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd49e799-0628-4c4d-a6a1-391285d73b47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:20.199801 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd49e799-0628-4c4d-a6a1-391285d73b47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:20.201345 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-cd49e799-0628-4c4d-a6a1-391285d73b47 admin admin] 10.222.0.81 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1097019
Jun 01 12:29:22.321906 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53308) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:22.439455 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6a91ce31-1097-44fd-9483-e6f508c36960 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:22.440708 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-6a91ce31-1097-44fd-9483-e6f508c36960 admin admin] 10.222.0.81 "GET /v2.0/subnets/2beaec64-809a-4898-9fbd-86950371b4e0 HTTP/1.1" status: 200  len: 868 time: 0.1178005
Jun 01 12:29:24.573932 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53318) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:24.676902 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13e12379-4c67-4a41-8919-70b1ba9c5d8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:24.678227 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-13e12379-4c67-4a41-8919-70b1ba9c5d8f admin admin] 10.222.0.81 "GET /v2.0/subnets/84d66640-a99d-4108-a81c-3480c5626219 HTTP/1.1" status: 200  len: 816 time: 0.1033702
Jun 01 12:29:32.880305 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:29:39.791510 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-09231504-e2d7-45ed-88c0-1bda4b2b3f2f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:42.308562 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:42.637608 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-3da3f9f0-df21-46a9-b668-06c8902ddfa2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:43.803848 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:45.348084 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:47.598254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53362) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:47.656167 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [None req-c50f2ab3-e457-45f6-bf6b-172efb755b28 admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91979) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:29:47.657142 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c50f2ab3-e457-45f6-bf6b-172efb755b28 admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0579965
Jun 01 12:29:49.844956 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53372) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:49.913187 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.pecan_wsgi.hooks.translation [None req-a0afa271-2849-4823-9e77-699db8cf2ad8 admin admin] GET failed (client error): The resource could not be found.
Jun 01 12:29:49.914462 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a0afa271-2849-4823-9e77-699db8cf2ad8 admin admin] 10.222.0.81 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0685899
Jun 01 12:29:50.039332 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36746447-6b9d-43cc-adf4-1aa68dc7ec69 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:50.040717 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-36746447-6b9d-43cc-adf4-1aa68dc7ec69 admin admin] 10.222.0.81 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1223867
Jun 01 12:29:52.188862 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53382) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:52.236899 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:29:52.241331 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:29:52.250692 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:29:52.260101 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Made reservation on behalf of 376dc29840f4476ba0a86b99827e33e1 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:29:52.262320 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:52.348916 dv-cinder-793515-2-iscsi neutron-server[91978]: WARNING neutron.services.revisions.revision_plugin [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7f7a2566d0a0] {project_id='376dc29840f4476ba0a86b99827e33e1', id='71ffd7d2-2aee-441a-8093-40e80ddc4f80', target_tenant='*', action='access_as_shared', object_id='de0cc047-8e57-4f38-85b9-53559146774c'}> to bump revision.
Jun 01 12:29:52.359626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] vlan segment allocate from pool success with {'vlan_id': 755, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:29:52.368665 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:52.368924 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Added segment 09292cec-f1f4-42eb-9348-a59d2b14621d of type vlan for network de0cc047-8e57-4f38-85b9-53559146774c
Jun 01 12:29:52.393855 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:52.422649 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:52.423907 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:52.424480 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:52.429143 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:29:52.524844 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3347955
Jun 01 12:29:52.526069 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Pushing event updated for resources: {'Network': ['ID=de0cc047-8e57-4f38-85b9-53559146774c,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:29:52.528821 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:29:52.536540 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network de0cc047-8e57-4f38-85b9-53559146774c details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:29:54.650452 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53392) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:29:54.715663 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c698c43-848b-4f9b-bc8e-5b33ca76f321 admin admin] GET failed (client error): The resource could not be found.
Jun 01 12:29:54.716170 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2c698c43-848b-4f9b-bc8e-5b33ca76f321 admin admin] Synchronizing usage tracker for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:network {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:29:54.731288 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2c698c43-848b-4f9b-bc8e-5b33ca76f321 admin admin] Unset dirty status for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:network {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:29:54.732376 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2c698c43-848b-4f9b-bc8e-5b33ca76f321 admin admin] 10.222.0.81 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0809643
Jun 01 12:29:54.835067 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bda6433d-207c-4ea5-9830-088e7db6fd36 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:54.836434 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bda6433d-207c-4ea5-9830-088e7db6fd36 admin admin] 10.222.0.81 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1002173
Jun 01 12:29:54.847827 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Request body: {'subnet': {'description': 'shared-subnet', 'ip_version': 4, 'name': 'shared-subnet', 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c', 'cidr': '192.168.233.0/24'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:29:54.852402 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:29:54.862388 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:29:54.872129 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Made reservation on behalf of 376dc29840f4476ba0a86b99827e33e1 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:29:54.875629 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:55.241127 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:55.245477 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:29:55.315949 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Pushing event updated for resources: {'Subnet': ['ID=964bc736-63b8-4385-b8d7-02191bbd7adb,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:29:55.318074 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Checking segment: {'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:29:55.318412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Network hostable DHCP agents. Network: de0cc047-8e57-4f38-85b9-53559146774c, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:29:55.321032 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:29:55.336037 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Network de0cc047-8e57-4f38-85b9-53559146774c is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:29:55.345823 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, de0cc047-8e57-4f38-85b9-53559146774c) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:29:55.350095 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:29:55.351498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:55.355950 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-238b427d-cb44-4085-baf5-6b2192614f8e None None] Network de0cc047-8e57-4f38-85b9-53559146774c requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:29:55.373565 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.5295990
Jun 01 12:29:55.577199 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-de0cc047-8e57-4f38-85b9-53559146774c', 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c', 'tenant_id': '376dc29840f4476ba0a86b99827e33e1', 'fixed_ips': [{'subnet_id': '964bc736-63b8-4385-b8d7-02191bbd7adb'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:29:55.578027 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:55.736350 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Allocated IP 192.168.233.2 (de0cc047-8e57-4f38-85b9-53559146774c/964bc736-63b8-4385-b8d7-02191bbd7adb/56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:29:55.946205 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:55.956356 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Transition to ACTIVE for port object 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:29:55.974516 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Transition to ACTIVE for port object 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:29:55.980142 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:55.985276 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:29:56.052533 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Network de0cc047-8e57-4f38-85b9-53559146774c is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:29:56.055338 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:29:56.059630 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:29:56.061745 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Pushing event updated for resources: {'Port': ['ID=56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:29:56.095089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.095438 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.095764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.096088 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.096430 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.096761 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.097089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.097404 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.097740 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.098060 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.098378 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.098705 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:29:56.106676 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:29:56.161039 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Attempting to bind port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:29:56.161405 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Attempting to bind port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:29:56.161760 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Attempting to bind port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee on network de0cc047-8e57-4f38-85b9-53559146774c {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:29:56.167277 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 29, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:29:56.167640 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Checking segment: {'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:29:56.168035 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:56.168422 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Bound using segment: {'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:29:56.168920 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Bound port: 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:29:56.169289 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:56.266992 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] For port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:29:56.270260 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] For port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee,segment=NetworkSegment(09292cec-f1f4-42eb-9348-a59d2b14621d),segment_id=09292cec-f1f4-42eb-9348-a59d2b14621d)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:29:56.275348 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:56.280359 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:29:56.356615 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Pushing event updated for resources: {'Port': ['ID=56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:29:56.391082 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:29:57.066279 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:29:57.155769 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:29:57.183526 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5904d015-a1ab-45ca-b9e8-bbe1714113d2 None None] Network de0cc047-8e57-4f38-85b9-53559146774c requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:29:57.286874 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Provisioning for port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:29:57.297422 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Provisioning complete for port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:29:57.297781 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:57.515820 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:57.560074 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] For port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee,segment=NetworkSegment(09292cec-f1f4-42eb-9348-a59d2b14621d),segment_id=09292cec-f1f4-42eb-9348-a59d2b14621d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:29:57.565116 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:57.567352 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:29:57.640839 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Pushing event updated for resources: {'Port': ['ID=56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:29:57.644218 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:29:57.786863 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-d47fffe8-c125-4918-a560-614fa546d37a None None] Provisioning complete for port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:29:57.787153 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-d47fffe8-c125-4918-a560-614fa546d37a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:29:59.022856 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:29:59.110643 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 56f6b3fd-f5c0-4fc0-9b8e-05f10a0222ee triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:29:59.111012 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:09.796727 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-a542f6bc-cc62-4ba0-bb56-b184d75f7555 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:09.879945 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:30:12.311275 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:12.639979 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-0c6e7cb1-fe94-46d1-8f63-a99d4347ae25 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:13.807394 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:15.342092 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:39.810793 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6834b10d-7330-437d-add2-b0db8f965666 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:42.316849 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:42.644211 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-3ced0cfe-d987-45d3-b435-8c2f4c85af46 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:43.810427 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:45.343510 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:30:46.880282 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:31:05.538750 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53444) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:31:05.544724 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [None req-b54d4e5b-367d-4d31-b1a9-0e1bf9ee16c6 tempest-verify_tempest_config-1933320806 tempest-verify_tempest_config-1933320806-project] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91978) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:31:05.545658 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b54d4e5b-367d-4d31-b1a9-0e1bf9ee16c6 tempest-verify_tempest_config-1933320806 tempest-verify_tempest_config-1933320806-project] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0059772
Jun 01 12:31:05.866347 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53462) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:31:05.987815 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:06.042756 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:31:06.046539 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Usage tracker for resource:security_group_rule and tenant:40131973d5444ed790fc5f089ba96a7a is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:31:06.049330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:31:06.054928 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:31:06.140141 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:06.143671 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:06.150926 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:31:06.189890 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Synchronizing usage tracker for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:31:06.193202 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31b1da3e-c0ce-465f-8183-0f380bd2d327,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:31:06.202428 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.202780 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.203111 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.203431 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.203747 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.204082 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.204424 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.204866 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.205042 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.205401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.205713 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.206024 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.210967 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:31:06.219495 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Unset dirty status for tenant:376dc29840f4476ba0a86b99827e33e1 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:31:06.223455 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53468) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:31:06.223998 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=40131973d5444ed790fc5f089ba96a7a&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3561110
Jun 01 12:31:06.294863 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:06.319943 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:06.415652 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:06.420177 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:31:06.431184 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31b1da3e-c0ce-465f-8183-0f380bd2d327,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:31:06.444414 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.444724 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.445061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.445397 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.445727 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.446082 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.446416 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.446723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.447042 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.447346 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.447665 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.447982 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Tracked resource versions report:
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]: pushed versions:
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]: {   'AddressGroup': {'1.2'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'ConntrackHelper': {'1.0'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Log': {'1.0'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Network': {'1.1'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Port': {'1.7'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'PortForwarding': {'1.2'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'QosPolicy': {'1.8'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'SecurityGroup': {'1.4'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'SubPort': {'1.0'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Subnet': {'1.1'},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Trunk': {'1.1'}}
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]: consumer versions:
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Log': '1.0',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Network': '1.1',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Port': '1.7',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'PortForwarding': '1.2',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'QosPolicy': '1.8',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'SecurityGroup': '1.4',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'SubPort': '1.0',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Subnet': '1.1',
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Trunk': '1.1'}}
Jun 01 12:31:06.449081 dv-cinder-793515-2-iscsi neutron-server[91979]:  {{(pid=91979) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:31:06.470735 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:06.471866 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/31b1da3e-c0ce-465f-8183-0f380bd2d327 HTTP/1.1" status: 204  len: 168 time: 0.2474761
Jun 01 12:31:06.480455 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:31:09.806966 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f5842df7-77da-4413-a306-585ccc525102 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:12.310627 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:12.648225 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-d6b141f3-a1f6-420d-865e-55a95d48cd8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:13.810989 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:15.346646 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:23.879201 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:31:39.808689 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-449b152f-dac9-4fa6-ad86-3f81a3940b99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:42.312522 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:42.652831 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ffdc7177-8560-4610-99ef-021d0b761393 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:43.813497 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:31:45.349851 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:00.878164 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:32:09.810927 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-60db33bd-5023-41a0-ae6a-8f39682dcdd8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:12.314800 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:12.654535 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7fc1fdd1-2df5-4ad7-baab-1e3359828c0a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:13.815347 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:15.351751 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:37.876922 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 5 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:32:39.813105 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-d9c6e8da-094e-41ab-8b7e-3e44d2128889 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:42.069369 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510'] for agent, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:42.316238 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:42.656482 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-576f5b26-92ec-4135-a8ea-52ef283a5b26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:43.819157 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:45.354789 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:32:46.015145 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53524) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:32:46.125732 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c6ef4bc0-ae36-4b90-9588-e0876b0e455f admin admin] 10.222.0.81 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1094992
Jun 01 12:32:48.235329 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53534) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:32:48.294173 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-3842e040-f9c5-4d57-a9fd-ff1c5f09407c admin admin] 10.222.0.81 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0577157
Jun 01 12:33:09.814795 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-792fa65c-6399-4db3-9fda-7d4a69081e83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:12.025015 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:12.317748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:12.656616 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-4aa8927f-e539-4f2f-bfa7-7c074c3d896b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:13.821496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:14.877627 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:33:15.357629 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:39.834819 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-51d5fbaf-d0d0-4a43-a176-e7fc327b7277 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:42.039110 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:42.325440 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:42.662204 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-d77b9824-1a05-44a2-b74a-9d5a12fd31a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:43.826958 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:45.361563 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:33:51.876796 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:34:09.847348 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b91e2f63-c6fe-4c3f-ab07-1c9583873f12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:12.056245 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:12.329491 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:12.667681 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f311d574-7df1-47be-a262-3ed82c713afe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:13.832885 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:14.654971 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53736) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:14.972329 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-357211251-network', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:14.976805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:14.982241 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Usage tracker for resource:network and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:14.985575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:14.991602 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:15.002405 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Made reservation on behalf of b09a17145ef0415faebc5bbdb71e3f3c for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:15.005074 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.018522 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.034028 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:15.038338 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Usage tracker for resource:security_group_rule and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:15.042410 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:15.049578 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:15.145592 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.151208 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.155761 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bfe64a95-7b58-4e79-a8ff-736c6f74f57d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:15.180125 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53768) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:15.188334 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73d23c15-a0c6-408e-ba3a-bedc4eece2bd,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:15.197246 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.197603 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.197896 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.198219 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.198527 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.198856 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.199165 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.199648 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.199964 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.200266 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.200779 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.201090 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Tracked resource versions report:
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]: pushed versions:
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]: {   'AddressGroup': {'1.2'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'ConntrackHelper': {'1.0'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Log': {'1.0'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Network': {'1.1'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Port': {'1.7'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'PortForwarding': {'1.2'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'QosPolicy': {'1.8'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'SecurityGroup': {'1.4'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'SubPort': {'1.0'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Subnet': {'1.1'},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     'Trunk': {'1.1'}}
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]: consumer versions:
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     HyperV agent@hv-cinder-79351: {},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Log': '1.0',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Network': '1.1',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Port': '1.7',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'PortForwarding': '1.2',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'QosPolicy': '1.8',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'SecurityGroup': '1.4',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'SubPort': '1.0',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Subnet': '1.1',
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:                                                      'Trunk': '1.1'}}
Jun 01 12:34:15.202156 dv-cinder-793515-2-iscsi neutron-server[91978]:  {{(pid=91978) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:34:15.211639 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:15.217837 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] vlan segment allocate from pool success with {'vlan_id': 765, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:34:15.230507 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.230842 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Added segment 8ba820a7-3059-4021-81f0-532d307e1908 of type vlan for network a43c69f6-c415-4ad5-8f5b-032eacaeb49e
Jun 01 12:34:15.259115 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.290350 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.292205 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:15.292816 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.297616 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1430c157-67e0-410f-ae30-f5bf1e1fccbd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:15.364267 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.410654 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Pushing event updated for resources: {'Network': ['ID=a43c69f6-c415-4ad5-8f5b-032eacaeb49e,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:15.422685 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:34:15.423074 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:15.437617 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.7776687
Jun 01 12:34:15.437917 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53780) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:15.447373 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Request body: {'subnet': {'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-357211251-subnet', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:15.460460 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:15.467299 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Usage tracker for resource:subnet and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:15.472458 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:15.480501 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:15.501646 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Made reservation on behalf of b09a17145ef0415faebc5bbdb71e3f3c for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:15.508219 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.687087 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-724441416-network', 'tenant_id': 'ac8957d6acd0419f9863ee5fadc5649b'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:15.701187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:15.715881 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Usage tracker for resource:network and tenant:ac8957d6acd0419f9863ee5fadc5649b is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:15.722933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:15.730304 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53792) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:15.737620 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:15.803051 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Made reservation on behalf of ac8957d6acd0419f9863ee5fadc5649b for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:15.805833 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.827812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:15.850849 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:15.866953 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Usage tracker for resource:security_group_rule and tenant:ac8957d6acd0419f9863ee5fadc5649b is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:15.873396 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:15.886602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:16.077087 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-network', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:16.082599 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:16.089585 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Usage tracker for resource:network and tenant:5bf4a909afd242fab0afa824fd49eade is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:16.097347 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:16.105284 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:16.121666 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Made reservation on behalf of 5bf4a909afd242fab0afa824fd49eade for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:16.127100 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.137002 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.144679 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.152548 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.154522 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8c745af8-9a23-4bf7-b39a-ca504ccf05b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:16.180079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:16.185919 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Usage tracker for resource:security_group_rule and tenant:5bf4a909afd242fab0afa824fd49eade is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:16.190281 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:16.191408 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] vlan segment allocate from pool success with {'vlan_id': 786, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:34:16.197915 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=538b550e-9c64-4230-9180-96075133d64f,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:16.207953 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:16.209799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.210142 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.210509 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.210995 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.211236 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.211597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.211855 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.212160 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.212468 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.212827 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.213668 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.213970 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Tracked resource versions report:
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]: pushed versions:
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]: {   'AddressGroup': {'1.2'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'ConntrackHelper': {'1.0'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Log': {'1.0'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Network': {'1.1'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Port': {'1.7'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'PortForwarding': {'1.2'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'QosPolicy': {'1.8'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'SecurityGroup': {'1.4'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'SubPort': {'1.0'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Subnet': {'1.1'},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     'Trunk': {'1.1'}}
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]: consumer versions:
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     HyperV agent@hv-cinder-79351: {},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Log': '1.0',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Network': '1.1',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Port': '1.7',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'PortForwarding': '1.2',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'QosPolicy': '1.8',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'SecurityGroup': '1.4',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'SubPort': '1.0',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Subnet': '1.1',
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:                                                      'Trunk': '1.1'}}
Jun 01 12:34:16.215365 dv-cinder-793515-2-iscsi neutron-server[91979]:  {{(pid=91979) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:34:16.222481 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:16.249673 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8760163830501', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.250292 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f7a2740ae50> segment precommit_create {{(pid=91979) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
Jun 01 12:34:16.250812 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Added segment 1a6e7042-c02d-4865-b6a5-545f1bab5372 of type vlan for network 53a16a0a-0d86-46d5-81e4-dff69599238d
Jun 01 12:34:16.353315 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.360541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.369871 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.387785 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] vlan segment allocate from pool success with {'vlan_id': 790, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:34:16.394728 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:16.404930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.418254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:16.451557 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.452731 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Added segment 1396a8b0-159e-40ec-9e21-d81bb2064dbc of type vlan for network 5cafd137-be6a-4c7c-b850-6777e5242610
Jun 01 12:34:16.488424 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.491700 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b2f9524-815b-4333-9acd-f83c8b50e6a5,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:16.496372 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:16.508431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:16.509127 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.513193 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.548915 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Pushing event updated for resources: {'Subnet': ['ID=98e949e5-17bf-4e08-a5ea-232517784814,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:16.553221 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.556188 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:16.558508 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.564924 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:16.572861 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d0ba538f-e014-4d84-981c-4d9082e530cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:16.573004 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.055s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:16.590508 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Checking segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:16.590910 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Network hostable DHCP agents. Network: a43c69f6-c415-4ad5-8f5b-032eacaeb49e, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:34:16.665357 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.4841354
Jun 01 12:34:16.674225 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53844) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:16.678197 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Request body: {'subnet': {'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-724441416-subnet', 'tenant_id': 'ac8957d6acd0419f9863ee5fadc5649b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:16.689707 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:16.696203 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 0.9647739
Jun 01 12:34:16.696902 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Pushing event updated for resources: {'Network': ['ID=5cafd137-be6a-4c7c-b850-6777e5242610,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:16.699626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53850) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:16.705667 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Request body: {'subnet': {'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-subnet', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:16.707710 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 5cafd137-be6a-4c7c-b850-6777e5242610 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:34:16.709165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Pushing event updated for resources: {'Network': ['ID=53a16a0a-0d86-46d5-81e4-dff69599238d,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:16.711593 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Usage tracker for resource:subnet and tenant:ac8957d6acd0419f9863ee5fadc5649b is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:16.717169 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:16.723917 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:16.728499 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:16.730697 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:16.731748 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:16.734180 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 53a16a0a-0d86-46d5-81e4-dff69599238d details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:34:16.735431 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Usage tracker for resource:subnet and tenant:5bf4a909afd242fab0afa824fd49eade is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:16.738186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:34:16.741397 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:16.751029 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Made reservation on behalf of ac8957d6acd0419f9863ee5fadc5649b for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:16.753137 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:16.754161 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.779223 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Made reservation on behalf of 5bf4a909afd242fab0afa824fd49eade for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:16.780055 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, a43c69f6-c415-4ad5-8f5b-032eacaeb49e) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:16.781665 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.845881 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:16.846858 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.887229 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.4477627
Jun 01 12:34:16.889667 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53854) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:16.898106 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:16.907641 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:16.916417 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Usage tracker for resource:router and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:16.921530 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:16.930084 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:16.941448 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93f41a95-a4da-461c-97a1-6b0eba727372 None None] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:34:16.992702 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:16.999999 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.049266 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.362370 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.368423 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:17.388904 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53868) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:17.494121 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6295b8a8-665d-493b-bc88-f7898265e5fa,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:17.498069 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:17.531432 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Checking segment: {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:17.531775 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Network hostable DHCP agents. Network: 5cafd137-be6a-4c7c-b850-6777e5242610, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:34:17.546476 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:34:17.548890 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.560907 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Network 5cafd137-be6a-4c7c-b850-6777e5242610 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:34:17.582535 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 5cafd137-be6a-4c7c-b850-6777e5242610) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:17.587350 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:17.588604 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.638626 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 0.9354813
Jun 01 12:34:17.638863 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53878) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:17.646238 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53985dda-5322-455b-ac1a-a8ee440da289 None None] Network 5cafd137-be6a-4c7c-b850-6777e5242610 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:34:17.649881 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:17.664975 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:17.677956 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Usage tracker for resource:router and tenant:5bf4a909afd242fab0afa824fd49eade is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:17.685187 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:17.709504 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:17.733075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.734093 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.766939 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.832472 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:17.929375 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:18.018577 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:18.027720 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Usage tracker for resource:security_group_rule and tenant:9864c5779b4e4355849043abcc1b390d is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:18.032584 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:18.045714 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:18.229614 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Allocated IP 172.20.0.2 (a43c69f6-c415-4ad5-8f5b-032eacaeb49e/98e949e5-17bf-4e08-a5ea-232517784814/66529bfc-ad3a-43ec-a3aa-c7d360ab9c17) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:18.282528 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:18.333890 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba31d762-7a0d-4ed2-becf-ede76cfe862a None None] Network 5cafd137-be6a-4c7c-b850-6777e5242610 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:34:18.468138 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:18.513599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:18.541350 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:18.615531 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=9864c5779b4e4355849043abcc1b390d&name=default HTTP/1.1" status: 200  len: 2975 time: 1.2253103
Jun 01 12:34:18.625965 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53916) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:18.670948 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f550d5d-5e0d-4760-b60f-9153ecac51ec,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:18.703881 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 53924) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:18.711431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:18.831984 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:18.920615 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:18.937595 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Transition to ACTIVE for port object 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:18.955912 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:18.964468 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Transition to ACTIVE for port object 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:18.979636 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.006181 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.010040 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.016679 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:19.063747 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:19.066166 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:19.070040 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:19.075470 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Usage tracker for resource:security_group_rule and tenant:111253ffc7f440fbadb1d9d424412ae5 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:19.079380 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:19.080964 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:19.090871 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:19.099966 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.109387 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.146014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cdf0cb8d-bdfe-4594-b297-e53e395b7d22,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:19.159133 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:19.163159 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.185234 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Checking segment: {'id': '1a6e7042-c02d-4865-b6a5-545f1bab5372', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 786, 'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:19.185651 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Network hostable DHCP agents. Network: 53a16a0a-0d86-46d5-81e4-dff69599238d, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:34:19.188710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.238441 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.271485 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Attempting to bind port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:19.271999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Attempting to bind port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:19.272554 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Attempting to bind port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:19.291786 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:19.292824 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Checking segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:19.293596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.295004 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Bound using segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:19.298956 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Bound port: 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:19.299774 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Network 53a16a0a-0d86-46d5-81e4-dff69599238d is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:34:19.300910 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.326849 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 53a16a0a-0d86-46d5-81e4-dff69599238d) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:19.333138 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.336836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:19.337418 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.350766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e85264fe-cdd1-499c-bf08-41365e56041e None None] Network 53a16a0a-0d86-46d5-81e4-dff69599238d requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:34:19.351011 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:19.383744 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f550d5d-5e0d-4760-b60f-9153ecac51ec,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:19.386399 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.387501 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4f550d5d-5e0d-4760-b60f-9153ecac51ec HTTP/1.1" status: 204  len: 168 time: 0.7580273
Jun 01 12:34:19.388384 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:19.400080 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 2.7197213
Jun 01 12:34:19.501367 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Allocated IP 172.27.3.95 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/d6f1f113-e8d7-469b-a186-85c504c1ea64) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:19.512547 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.522691 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.552223 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:19.564067 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=111253ffc7f440fbadb1d9d424412ae5&name=default HTTP/1.1" status: 200  len: 2975 time: 0.8523676
Jun 01 12:34:19.564834 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 53954) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:19.574676 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Pushing event updated for resources: {'Port': ['ID=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:19.599269 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d87237b0-d772-4b15-b2ab-3726bf5a9168,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:19.605554 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:19.725593 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.789395 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.850557 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.850895 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.851225 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.851542 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.851858 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.852173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.852483 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.855463 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.857173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.857513 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.858960 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.859318 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.859642 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Tracked resource versions report:
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]: pushed versions:
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]: {   'AddressGroup': {'1.2'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'ConntrackHelper': {'1.0'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Log': {'1.0'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Network': {'1.1'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Port': {'1.7'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'PortForwarding': {'1.2'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'QosPolicy': {'1.8'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'SecurityGroup': {'1.4'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'SubPort': {'1.0'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Subnet': {'1.1'},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     'Trunk': {'1.1'}}
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]: consumer versions:
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     HyperV agent@hv-cinder-79351: {},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Log': '1.0',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Network': '1.1',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Port': '1.7',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'PortForwarding': '1.2',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'QosPolicy': '1.8',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'SecurityGroup': '1.4',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'SubPort': '1.0',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Subnet': '1.1',
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:                                                      'Trunk': '1.1'}}
Jun 01 12:34:19.860671 dv-cinder-793515-2-iscsi neutron-server[91980]:  {{(pid=91980) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:34:19.867223 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b2c3a2d-96de-416e-859c-af36f917e248 None None] Network 53a16a0a-0d86-46d5-81e4-dff69599238d requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:34:19.890916 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.874s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:19.914730 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:19.928130 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:19.999792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:20.069061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:20.104115 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:20.107925 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] For port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:20.116290 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:20.122819 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d87237b0-d772-4b15-b2ab-3726bf5a9168,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:20.123599 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:20.131853 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:20.145615 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] For port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:20.147087 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:20.155660 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/d87237b0-d772-4b15-b2ab-3726bf5a9168 HTTP/1.1" status: 204  len: 168 time: 0.5861561
Jun 01 12:34:20.168586 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:20.192206 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Allocated IP 172.27.3.110 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/ddafe269-b2d0-4254-9d25-4ed75004082e) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:20.193333 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-a9ea997a-d19c-4d2e-938d-db885f31af0e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:20.381300 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54004) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:20.410388 dv-cinder-793515-2-iscsi neutron-server[91979]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 01 12:34:20.508248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Pushing event updated for resources: {'Port': ['ID=d6f1f113-e8d7-469b-a186-85c504c1ea64,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:20.525906 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.597s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:20.549360 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Pushing event updated for resources: {'Port': ['ID=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:20.558718 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.368s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:20.691492 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:20.893453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:20.908324 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:20.999536 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:21.030852 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:21.036430 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54030) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:21.041597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:21.057821 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:21.248814 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:21.258351 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Pushing event updated for resources: {'Port': ['ID=ddafe269-b2d0-4254-9d25-4ed75004082e,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:21.290884 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.382s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:21.301466 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-00f4cb5f-8c6d-4f88-8fac-ee050590e3c5 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:21.302695 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-00f4cb5f-8c6d-4f88-8fac-ee050590e3c5 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Synchronizing usage tracker for tenant:ac8957d6acd0419f9863ee5fadc5649b on resource:network {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:21.356299 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:21.356813 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:21.404868 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Usage tracker for resource:security_group_rule and tenant:20aec83592c845469007e232647a1732 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:21.424716 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:21.486660 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:21.597336 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:21.678134 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54042) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:21.690676 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:21.788723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:21.849442 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54062) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:21.857135 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-90bb5232-9386-4da4-9145-175c468cb7df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:21.874774 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:21.898258 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51cd33d1-b1f2-43e0-b214-2eb77e11fab2,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:21.902325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-00f4cb5f-8c6d-4f88-8fac-ee050590e3c5 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Unset dirty status for tenant:ac8957d6acd0419f9863ee5fadc5649b on resource:network {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:21.904430 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-00f4cb5f-8c6d-4f88-8fac-ee050590e3c5 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/networks?id=53a16a0a-0d86-46d5-81e4-dff69599238d HTTP/1.1" status: 200  len: 811 time: 1.5204813
Jun 01 12:34:21.905861 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:21.937795 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-31ca4c6e-a2cc-4959-9332-941bffe48e12 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/quotas/ac8957d6acd0419f9863ee5fadc5649b HTTP/1.1" status: 200  len: 375 time: 0.0184071
Jun 01 12:34:22.013598 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2e7b6a1-98d2-4c6a-8b55-531acb40a2ec None None] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:34:22.132144 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Provisioning for port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:22.161104 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.161680 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Provisioning complete for port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:22.162233 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.220264 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.226597 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-929f5d55-d8e6-4e95-9c55-7e6c3eb06578 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=ac8957d6acd0419f9863ee5fadc5649b&fields=id HTTP/1.1" status: 200  len: 210 time: 0.2260630
Jun 01 12:34:22.231868 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=20aec83592c845469007e232647a1732&name=default HTTP/1.1" status: 200  len: 2975 time: 1.1920211
Jun 01 12:34:22.241599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54070) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:22.289632 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:22.300391 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.318259 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Usage tracker for resource:security_group_rule and tenant:f63fcd850f4b416b87f4e45bbe216a87 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:22.329999 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:22.347335 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:22.353322 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:22.363678 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Usage tracker for resource:security_group_rule and tenant:d4cedc84684f4cce9ced4fb626d668ec is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:22.376764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:22.393350 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:22.404335 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.463255 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.466859 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91978) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:34:22.467996 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.526296 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] For port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:22.531088 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.538692 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:22.645915 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Pushing event updated for resources: {'Port': ['ID=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:22.651517 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:22.697658 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-1c61915a-80d3-4f57-be9d-0b1f8717ea61 service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91979) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:34:22.698659 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-1c61915a-80d3-4f57-be9d-0b1f8717ea61 service neutron] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.2813530
Jun 01 12:34:22.705013 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.816408 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.825567 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.832217 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.834638 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-eb6463d1-84e2-4779-af26-3ff6af1e987b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:22.862540 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.862762 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-483f6881-6d31-40e1-a4f6-f8d6bf2e7710 None None] Provisioning complete for port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:22.863475 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-483f6881-6d31-40e1-a4f6-f8d6bf2e7710 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.925376 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:22.945518 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:34:22.958575 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:22.961469 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Sync routers for ids ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:34:22.986710 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Routers {'4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:22.987823 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6940>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:23.000245 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51cd33d1-b1f2-43e0-b214-2eb77e11fab2,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:23.005296 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f63fcd850f4b416b87f4e45bbe216a87&name=default HTTP/1.1" status: 200  len: 2975 time: 1.3244538
Jun 01 12:34:23.011285 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:23.014964 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54100) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:23.015165 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d4cedc84684f4cce9ced4fb626d668ec&name=default HTTP/1.1" status: 200  len: 2975 time: 1.1584346
Jun 01 12:34:23.015268 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-bfb8a089-070b-4f1b-9a23-014de44636f0 service neutron] 10.222.0.81 "GET /v2.0/networks/53a16a0a-0d86-46d5-81e4-dff69599238d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3032298
Jun 01 12:34:23.026465 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54102) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:23.051977 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:23.052565 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=612301e5-a443-4f2a-83da-b6554e74b6fb,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:23.052800 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/51cd33d1-b1f2-43e0-b214-2eb77e11fab2 HTTP/1.1" status: 204  len: 168 time: 0.8101387
Jun 01 12:34:23.057486 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:23.057925 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.132s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:23.093354 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=057a45da-8926-4729-b9c9-10b0a1992ebf,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:23.098992 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:23.108318 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:23.111265 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 5.4712193
Jun 01 12:34:23.114489 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54114) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:23.289564 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:23.426028 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:23.426411 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:23.600274 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Set router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:23.608032 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-5b5a3f37-9e9d-43e5-b1ed-e90580d5bcff service neutron] 10.222.0.81 "GET /v2.0/networks/53a16a0a-0d86-46d5-81e4-dff69599238d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5799441
Jun 01 12:34:23.734931 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:23.786003 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:23.899060 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:23.919572 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54146) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:23.922376 dv-cinder-793515-2-iscsi neutron-server[91978]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
Jun 01 12:34:23.933670 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.059031 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91979) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:34:24.094154 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7e6f34a8-bcb2-43d4-be3c-f6dc649f8b25 req-df877dd1-c6dd-4e37-b000-d8788e4346bf tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 210 time: 0.1737928
Jun 01 12:34:24.152862 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54162) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:24.162800 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6940>, [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:20Z', 'revision_number': 3, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:24.168717 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Checking router: 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:34:24.169036 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Updating router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b port d6f1f113-e8d7-469b-a186-85c504c1ea64 binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:34:24.199154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.214797 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:24.239982 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.294222 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=057a45da-8926-4729-b9c9-10b0a1992ebf,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:24.328455 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:24.329328 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.333406 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/057a45da-8926-4729-b9c9-10b0a1992ebf HTTP/1.1" status: 204  len: 168 time: 1.2833443
Jun 01 12:34:24.336726 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.341771 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.342857 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/612301e5-a443-4f2a-83da-b6554e74b6fb HTTP/1.1" status: 204  len: 168 time: 1.3277397
Jun 01 12:34:24.345965 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b7331246-2ca1-4ee5-97b3-4d7c3760b3b8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:24.361745 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=612301e5-a443-4f2a-83da-b6554e74b6fb,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:24.366179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:24.382366 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:34:24.395879 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Sync routers for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:34:24.411848 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:24.412593 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fec220>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:24.418549 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Notify callbacks [] for router, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.420102 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 7.5294595
Jun 01 12:34:24.422945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54174) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:24.543048 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.807272 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:24.907623 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.920289 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Allocated IP 172.20.0.1 (5cafd137-be6a-4c7c-b850-6777e5242610/6295b8a8-665d-493b-bc88-f7898265e5fa/bcc33710-f3d9-4f03-8973-7059a54c1e11) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:24.945498 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Transition to ACTIVE for port object d6f1f113-e8d7-469b-a186-85c504c1ea64 will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:24.960093 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:24.976728 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:24.985229 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.021563 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:25.027589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Usage tracker for resource:security_group_rule and tenant:d5abc3bd7c344b0fad09338fb7b74750 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:25.031584 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:25.039455 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:25.114147 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.152941 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.163498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6104b3e4-5baa-4421-bb81-54697c68a5b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:25.168473 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Pushing event updated for resources: {'Port': ['ID=d6f1f113-e8d7-469b-a186-85c504c1ea64,revision_number=2']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:25.170957 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.175314 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.189578 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:25.193026 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.201507 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.205256 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.207196 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.207745 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.208284 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.209569 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Network 5cafd137-be6a-4c7c-b850-6777e5242610 is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:25.210285 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.213527 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.215365 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.215935 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.216589 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.216926 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:25.219573 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:25.220341 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.222333 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Tracked resource versions report:
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]: pushed versions:
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]: {   'AddressGroup': {'1.2'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'ConntrackHelper': {'1.0'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Log': {'1.0'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Network': {'1.1'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Port': {'1.7'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'PortForwarding': {'1.2'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'QosPolicy': {'1.8'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'SecurityGroup': {'1.4'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'SecurityGroupRule': {'1.2'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'SubPort': {'1.0'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Subnet': {'1.1'},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     'Trunk': {'1.1'}}
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]: consumer versions:
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]: {   DHCP agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     HyperV agent@hv-cinder-79351: {},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     L3 agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     Metadata agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     Metering agent@dv-cinder-793515-2-iscsi: {},
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:     Open vSwitch agent@dv-cinder-793515-2-iscsi: {   'AddressGroup': '1.2',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'ConntrackHelper': '1.0',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Log': '1.0',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Network': '1.1',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Port': '1.7',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'PortForwarding': '1.2',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'QosPolicy': '1.8',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'SecurityGroup': '1.4',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'SecurityGroupRule': '1.2',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'SubPort': '1.0',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Subnet': '1.1',
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:                                                      'Trunk': '1.1'}}
Jun 01 12:34:25.223512 dv-cinder-793515-2-iscsi neutron-server[91981]:  {{(pid=91981) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
Jun 01 12:34:25.238215 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:25.239203 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e22555e-da9d-4143-9e78-8f3e0d66be17,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:25.242331 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:25.279304 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Attempting to bind port d6f1f113-e8d7-469b-a186-85c504c1ea64 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:25.281424 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Attempting to bind port d6f1f113-e8d7-469b-a186-85c504c1ea64 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:25.282584 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Attempting to bind port d6f1f113-e8d7-469b-a186-85c504c1ea64 on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:25.337469 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:25.338263 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:25.338814 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.339331 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:25.339944 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Bound port: d6f1f113-e8d7-469b-a186-85c504c1ea64, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:25.341006 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.348700 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fec220>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:21Z', 'revision_number': 3, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:25.356222 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Checking router: 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:34:25.356793 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Updating router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae port ddafe269-b2d0-4254-9d25-4ed75004082e binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:34:25.368771 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Pushing event updated for resources: {'Port': ['ID=bcc33710-f3d9-4f03-8973-7059a54c1e11,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:25.374230 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:25.429730 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.437028 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.477340 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54208) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:25.485634 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3330b8ba-2dae-409a-a6e6-fd0141a01b56 req-b01c468a-0057-467b-8354-4834d2a4d9c2 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 210 time: 0.1810138
Jun 01 12:34:25.536837 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d5abc3bd7c344b0fad09338fb7b74750&name=default HTTP/1.1" status: 200  len: 2975 time: 1.3673992
Jun 01 12:34:25.537809 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54212) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:25.547545 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.547752 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] For port d6f1f113-e8d7-469b-a186-85c504c1ea64, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:25.556227 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] For port d6f1f113-e8d7-469b-a186-85c504c1ea64, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=d6f1f113-e8d7-469b-a186-85c504c1ea64,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:25.562009 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.584788 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:25.601533 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:25.718682 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Routers {'4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:25.719316 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6940>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:25.782072 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Usage tracker for resource:security_group_rule and tenant:6593827df32543f58711f65416b87aa1 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:25.795495 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:25.795745 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.804581 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:25.859341 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.883699 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.891266 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bf55c68e-14e8-4f60-a10a-75b7b4f69047 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:25.906204 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Pushing event updated for resources: {'Port': ['ID=d6f1f113-e8d7-469b-a186-85c504c1ea64,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:25.933057 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:25.937386 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.964749 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Transition to ACTIVE for port object ddafe269-b2d0-4254-9d25-4ed75004082e will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:25.978102 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:25.988927 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:26.055380 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.077644 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.087921 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Attempting to bind port ddafe269-b2d0-4254-9d25-4ed75004082e on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:26.088286 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Attempting to bind port ddafe269-b2d0-4254-9d25-4ed75004082e by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:26.088687 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Attempting to bind port ddafe269-b2d0-4254-9d25-4ed75004082e on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:26.099582 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:26.100086 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:26.100500 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.102249 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:26.104154 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:26.104863 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Bound port: ddafe269-b2d0-4254-9d25-4ed75004082e, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:26.105131 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.151647 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d985de0-a0f1-4af1-a28a-e3b7d4fe418b None None] Pushing event updated for resources: {'Port': ['ID=ddafe269-b2d0-4254-9d25-4ed75004082e,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:26.155089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7d985de0-a0f1-4af1-a28a-e3b7d4fe418b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:26.235654 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] For port ddafe269-b2d0-4254-9d25-4ed75004082e, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:26.236581 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0bc2b980-7763-4273-9aec-5cd99adf990f,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:26.249458 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=6593827df32543f58711f65416b87aa1&name=default HTTP/1.1" status: 200  len: 2975 time: 0.7694578
Jun 01 12:34:26.254976 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] For port ddafe269-b2d0-4254-9d25-4ed75004082e, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=ddafe269-b2d0-4254-9d25-4ed75004082e,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:26.261712 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.265861 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:26.270273 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54236) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:26.278052 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:26.284966 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] Set router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:26.409143 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.442791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.464759 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.484024 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:26.484828 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fec220>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:26.509830 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Network 5cafd137-be6a-4c7c-b850-6777e5242610 is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:26.520353 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:26.626751 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.635462 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Pushing event updated for resources: {'Port': ['ID=bcc33710-f3d9-4f03-8973-7059a54c1e11,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:26.694049 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.803s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:26.700412 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.758909 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:26.771275 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d985de0-a0f1-4af1-a28a-e3b7d4fe418b None None] Pushing event updated for resources: {'Port': ['ID=ddafe269-b2d0-4254-9d25-4ed75004082e,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:26.779609 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2541e244-ea51-49f4-bc71-1c5dcffa5ed8 req-2a1b6539-9dec-4cdc-a652-5c09d41b5260 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 210 time: 0.1460271
Jun 01 12:34:26.806158 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7d985de0-a0f1-4af1-a28a-e3b7d4fe418b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.528s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:26.848263 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e22555e-da9d-4143-9e78-8f3e0d66be17,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:26.859010 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:26.859986 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:26.866526 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0e22555e-da9d-4143-9e78-8f3e0d66be17 HTTP/1.1" status: 204  len: 168 time: 1.0683596
Jun 01 12:34:26.912504 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:27.039245 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:27.083673 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:27.095019 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-089848a0-398a-4a66-a8d5-47207ac72a8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:27.113084 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6940>, [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 4, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'bcc33710-f3d9-4f03-8973-7059a54c1e11', 'name': '', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'mac_address': 'fa:16:3e:ab:15:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:24Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 2, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'subnets': [{'id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:27.119201 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-827ddbe9-175c-448d-9a76-480bc9e266b6 None None] The sync data for ids ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'] in dv-cinder-793515-2-iscsi is: [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 4, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'bcc33710-f3d9-4f03-8973-7059a54c1e11', 'name': '', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'mac_address': 'fa:16:3e:ab:15:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:24Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 2, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'subnets': [{'id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:34:27.202342 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bc2b980-7763-4273-9aec-5cd99adf990f,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:27.204172 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:34:27.227984 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:27.292268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:27.293461 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0bc2b980-7763-4273-9aec-5cd99adf990f HTTP/1.1" status: 204  len: 168 time: 1.0222068
Jun 01 12:34:27.409706 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Allocated IP 172.20.0.1 (a43c69f6-c415-4ad5-8f5b-032eacaeb49e/98e949e5-17bf-4e08-a5ea-232517784814/c41297e3-3729-4961-8e43-0de027b9fe9f) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:27.704248 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:27.708439 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:34:27.720180 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] 10.222.0.81 "PUT /v2.0/routers/4cc34e86-2aec-44cb-a4d3-797d45bd3d9b/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.6045265
Jun 01 12:34:27.746755 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Transition to ACTIVE for port object c41297e3-3729-4961-8e43-0de027b9fe9f will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:27.789051 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:27.799817 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-23ac9dc4-759b-4fe0-a96c-bd97d63f79d9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:27.864624 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fec220>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:21Z', 'revision_number': 3, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:27.871021 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19579959-1b01-4f9a-b58a-d026677f0c4c None None] The sync data for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi is: [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:21Z', 'revision_number': 3, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:26Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:34:27.941397 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:27.950945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:27.955553 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:27.956278 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:28.155314 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54294) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:28.209934 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:28.277692 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.95', 56330) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:28.313234 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-ba9a0fe8-3365-4246-bd1c-e30456fa427e None None] Provisioning for port c41297e3-3729-4961-8e43-0de027b9fe9f completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:28.319848 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-ba9a0fe8-3365-4246-bd1c-e30456fa427e None None] Provisioning complete for port c41297e3-3729-4961-8e43-0de027b9fe9f triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:28.321674 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ba9a0fe8-3365-4246-bd1c-e30456fa427e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:28.332211 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:28.495926 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Usage tracker for resource:security_group_rule and tenant:d2eb6a47c7a241ca8e8582f114ecb2b0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:28.505444 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:28.520869 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-ba9a0fe8-3365-4246-bd1c-e30456fa427e None None] Port c41297e3-3729-4961-8e43-0de027b9fe9f cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:34:28.522320 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:28.555190 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Pushing event updated for resources: {'Port': ['ID=c41297e3-3729-4961-8e43-0de027b9fe9f,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:28.564694 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.765s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:28.623473 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a68cd556-e12b-4859-a905-6164a7cb3d38 req-78c30536-28d8-4b14-97fc-8aeae6f1d03d tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 210 time: 0.1306024
Jun 01 12:34:28.894207 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:34:28.940159 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:28.950370 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-b0abf657-967c-4d2f-8606-1d39e111d42f tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:28.952041 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-b0abf657-967c-4d2f-8606-1d39e111d42f tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.95 "GET /v2.0/networks?id=53a16a0a-0d86-46d5-81e4-dff69599238d HTTP/1.1" status: 200  len: 811 time: 0.6733706
Jun 01 12:34:28.957317 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:28.962049 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:28.971753 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-64d8acdb-5bb4-4903-b7a5-4dee78e15346 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:29.031167 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Request body: {'port': {'device_id': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d', 'admin_state_up': True, 'tenant_id': 'ac8957d6acd0419f9863ee5fadc5649b'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:29.421300 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device d6f1f113-e8d7-469b-a186-85c504c1ea64 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:29.432622 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:29.444766 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Usage tracker for resource:port and tenant:ac8957d6acd0419f9863ee5fadc5649b is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:29.451107 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:29.467511 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:29.501581 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Made reservation on behalf of ac8957d6acd0419f9863ee5fadc5649b for: {'port': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:29.506805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:29.598716 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d2eb6a47c7a241ca8e8582f114ecb2b0&name=default HTTP/1.1" status: 200  len: 2977 time: 1.4397995
Jun 01 12:34:29.599316 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=128dbbb6-1de5-46f1-b320-d037c9da508b,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:29.642178 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.666s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:29.645223 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54336) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:29.645381 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:29.668724 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:29.673989 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:29.735777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:29.770431 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port d6f1f113-e8d7-469b-a186-85c504c1ea64 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:29.807235 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port d6f1f113-e8d7-469b-a186-85c504c1ea64 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:29.809920 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.266732 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.314168 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port d6f1f113-e8d7-469b-a186-85c504c1ea64, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=d6f1f113-e8d7-469b-a186-85c504c1ea64,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:30.320066 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.321266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device ddafe269-b2d0-4254-9d25-4ed75004082e up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:30.376055 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-124d57f2-7df6-4756-88c4-68130376ad2a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:30.418703 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:30.422811 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-59c0f6f8-38e1-4075-8352-f3277c10630d req-5c31fada-0d77-4d13-bbd4-c005ec97cd39 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 210 time: 0.1541033
Jun 01 12:34:30.431874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:30.522339 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=d6f1f113-e8d7-469b-a186-85c504c1ea64,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:30.565960 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:30.576122 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.620052 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port ddafe269-b2d0-4254-9d25-4ed75004082e completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:30.625468 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port ddafe269-b2d0-4254-9d25-4ed75004082e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:30.626204 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.689642 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Pushing event updated for resources: {'Port': ['ID=c41297e3-3729-4961-8e43-0de027b9fe9f,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:30.701822 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.966s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:30.719583 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-81eca954-21df-497d-b8f6-39c665546335 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:30.720195 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-81eca954-21df-497d-b8f6-39c665546335 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Synchronizing usage tracker for tenant:5bf4a909afd242fab0afa824fd49eade on resource:network {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:30.810480 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.874005 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.927666 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-652daae9-1620-49e0-998d-415a0bfec09e None None] Provisioning complete for port c41297e3-3729-4961-8e43-0de027b9fe9f triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:30.929141 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-652daae9-1620-49e0-998d-415a0bfec09e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.982063 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:30.995859 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Allocated IP 172.20.0.12 (53a16a0a-0d86-46d5-81e4-dff69599238d/cdf0cb8d-bdfe-4594-b297-e53e395b7d22/ce676d5b-517e-484e-a826-9939cb57df33) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:31.019695 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port ddafe269-b2d0-4254-9d25-4ed75004082e, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=ddafe269-b2d0-4254-9d25-4ed75004082e,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:31.024902 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:31.037543 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:31.045963 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:34:31.065045 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-92e1797f-75c5-469e-b6a4-788a319c2a78 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:31.133019 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-652daae9-1620-49e0-998d-415a0bfec09e None None] Port c41297e3-3729-4961-8e43-0de027b9fe9f cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:34:31.152152 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-81eca954-21df-497d-b8f6-39c665546335 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Unset dirty status for tenant:5bf4a909afd242fab0afa824fd49eade on resource:network {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:31.153374 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-81eca954-21df-497d-b8f6-39c665546335 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 819 time: 1.0905874
Jun 01 12:34:31.189464 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:31.189464 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/128dbbb6-1de5-46f1-b320-d037c9da508b HTTP/1.1" status: 204  len: 168 time: 1.3200529
Jun 01 12:34:31.189968 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=ddafe269-b2d0-4254-9d25-4ed75004082e,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:31.193524 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:31.200033 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=128dbbb6-1de5-46f1-b320-d037c9da508b,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:31.212858 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:31.214055 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54432) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:31.272220 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-81709c43-2515-4072-b26a-246584d56ee2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/quotas/5bf4a909afd242fab0afa824fd49eade HTTP/1.1" status: 200  len: 375 time: 0.0805216
Jun 01 12:34:31.375230 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device d6f1f113-e8d7-469b-a186-85c504c1ea64 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:31.602585 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port d6f1f113-e8d7-469b-a186-85c504c1ea64 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:31.626187 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:31.730266 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Sync routers for ids ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:34:31.748161 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Routers {'4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:31.754153 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:34:31.760195 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d63670>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:31.776584 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] 10.222.0.81 "PUT /v2.0/routers/7383f9c7-1b26-40bd-a446-a8f7fc4b76ae/add_router_interface HTTP/1.1" status: 200  len: 503 time: 7.3519382
Jun 01 12:34:31.960349 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc83a9ea-a756-4a69-9da6-a8714a4e5f22 req-6d84dddc-6138-44ec-83d5-0f96d7a1d077 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 210 time: 0.1353383
Jun 01 12:34:32.067120 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Sync routers for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:34:32.110784 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:32.116788 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d97520>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:32.137248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:32.194775 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:32.233675 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:32.276598 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:32.364116 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Set router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:32.387812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54466) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:32.392833 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Network 53a16a0a-0d86-46d5-81e4-dff69599238d is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:32.412142 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:32.428376 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Usage tracker for resource:security_group_rule and tenant:2856254c31b64fc6bb1c83c9376dda43 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:32.470722 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:32.481586 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:32.487782 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:32.487782 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:32.534445 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:32.572875 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:32.684622 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 3.6761231
Jun 01 12:34:32.692400 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-d9f30bf6-3de1-4c39-8a57-19a8fbd753bb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Synchronizing usage tracker for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:32.731884 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Pushing event updated for resources: {'Port': ['ID=ce676d5b-517e-484e-a826-9939cb57df33,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:32.750474 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.474s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:32.788973 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:32.970102 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:32.971225 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-d9f30bf6-3de1-4c39-8a57-19a8fbd753bb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Unset dirty status for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:32.987798 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:32.993881 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-d9f30bf6-3de1-4c39-8a57-19a8fbd753bb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&fields=id HTTP/1.1" status: 200  len: 255 time: 1.6157994
Jun 01 12:34:33.001092 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-c4edbc97-22d1-413b-a5f6-c787bf21766d tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91978) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:34:33.002128 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-c4edbc97-22d1-413b-a5f6-c787bf21766d tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.95 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0381930
Jun 01 12:34:33.003023 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:33.037240 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:33.060463 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Usage tracker for resource:security_group_rule and tenant:9caf0e3f07644a0b9364f7045e19e509 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:33.066199 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:33.080893 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:33.097687 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:33.185933 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2856254c31b64fc6bb1c83c9376dda43&name=default HTTP/1.1" status: 200  len: 2979 time: 1.9686644
Jun 01 12:34:33.190256 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eec6725a-5e1a-4f44-a9ca-3aeff16faeac,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:33.193657 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54502) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:33.197472 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:33.336464 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d63670>, [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 4, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'bcc33710-f3d9-4f03-8973-7059a54c1e11', 'name': '', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'mac_address': 'fa:16:3e:ab:15:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:24Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 2, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'subnets': [{'id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:33.372796 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Checking router: 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:34:33.376819 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Updating router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b port bcc33710-f3d9-4f03-8973-7059a54c1e11 binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:34:33.426621 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device ddafe269-b2d0-4254-9d25-4ed75004082e up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:33.524105 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:33.537826 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:33.735381 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:33.742065 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:33.821354 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port ddafe269-b2d0-4254-9d25-4ed75004082e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:33.821798 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:33.830254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:33.849709 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Request body: {'port': {'device_id': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:33.980503 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f826891-a379-40d2-bd95-b05aa677e942,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:34.009842 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.046982 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:34.059403 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-fe524190-9f90-429e-a3d7-3cd089c3bad0 service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91978) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:34:34.060568 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-fe524190-9f90-429e-a3d7-3cd089c3bad0 service neutron] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.2975910
Jun 01 12:34:34.065984 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=9caf0e3f07644a0b9364f7045e19e509&name=default HTTP/1.1" status: 200  len: 2979 time: 1.6768603
Jun 01 12:34:34.067801 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54528) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:34.084874 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d97520>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:29Z', 'revision_number': 2, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:34.105103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Checking router: 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:34:34.105790 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Updating router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae port c41297e3-3729-4961-8e43-0de027b9fe9f binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:34:34.216882 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.257583 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:34.286614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54534) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:34.289727 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.300439 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'security_group': {'name': 'tempest-securitygroup--830798424', 'description': 'tempest-description--467802977'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:34.323639 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:34.328605 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:34.332507 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:34.340035 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:34.379422 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.403089 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eec6725a-5e1a-4f44-a9ca-3aeff16faeac,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:34.415952 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:34.417413 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.419071 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.420226 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/eec6725a-5e1a-4f44-a9ca-3aeff16faeac HTTP/1.1" status: 204  len: 168 time: 1.2197516
Jun 01 12:34:34.456801 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:34.470660 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.493324 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group_rule and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:34.504969 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:34.547516 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:34.568037 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.602525 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.614467 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-77460b3f-2ec1-48b7-911e-ed747b82a4b4 service neutron] 10.222.0.81 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5311987
Jun 01 12:34:34.634662 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Transition to ACTIVE for port object bcc33710-f3d9-4f03-8973-7059a54c1e11 will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:34.648159 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.669598 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:34.812439 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58c7be51-3efb-4889-820c-4682a82c2ca7 req-4df22988-8498-491f-ae74-7198ff2acf0f tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:34.814619 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-58c7be51-3efb-4889-820c-4682a82c2ca7 req-4df22988-8498-491f-ae74-7198ff2acf0f tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 932 time: 0.2696855
Jun 01 12:34:34.819524 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:34.854586 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fe1770d9-fb0e-46bc-bfb1-bc984c5d822c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:34.879698 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c1f5d4-2aa1-4a62-9636-110a37430640 None None] Pushing event updated for resources: {'Port': ['ID=bcc33710-f3d9-4f03-8973-7059a54c1e11,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:34.922121 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f826891-a379-40d2-bd95-b05aa677e942,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:34.989558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:35.006641 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.018823 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/2f826891-a379-40d2-bd95-b05aa677e942 HTTP/1.1" status: 204  len: 168 time: 0.9239910
Jun 01 12:34:35.067505 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-f4c1f5d4-2aa1-4a62-9636-110a37430640 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.398s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:35.119472 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-58c7be51-3efb-4889-820c-4682a82c2ca7 req-4808a8d0-1262-45fe-b434-c7ff168c393a tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Synchronizing usage tracker for tenant:ac8957d6acd0419f9863ee5fadc5649b on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:35.214349 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.240192 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.267927 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-57578cc4-f07b-4aee-a25e-7302107ac3a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:35.279165 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.328409 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Transition to ACTIVE for port object c41297e3-3729-4961-8e43-0de027b9fe9f will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:35.346182 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-58c7be51-3efb-4889-820c-4682a82c2ca7 req-4808a8d0-1262-45fe-b434-c7ff168c393a tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Unset dirty status for tenant:ac8957d6acd0419f9863ee5fadc5649b on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:35.347457 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-58c7be51-3efb-4889-820c-4682a82c2ca7 req-4808a8d0-1262-45fe-b434-c7ff168c393a tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5251095
Jun 01 12:34:35.359602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5b099188-b099-49ba-b755-aea87c47873e,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:35.365908 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:35.379279 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.382361 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.387087 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 1.0916512
Jun 01 12:34:35.387597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54568) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:35.401308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'security_group_rule': {'security_group_id': '5b099188-b099-49ba-b755-aea87c47873e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:35.417404 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:35.418843 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Attempting to bind port bcc33710-f3d9-4f03-8973-7059a54c1e11 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:35.419101 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2501e5b5-2f73-40c7-9b7a-3a9d90ab28c0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:35.420683 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Attempting to bind port bcc33710-f3d9-4f03-8973-7059a54c1e11 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:35.421072 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Attempting to bind port bcc33710-f3d9-4f03-8973-7059a54c1e11 on network 5cafd137-be6a-4c7c-b850-6777e5242610 {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:35.427532 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group_rule and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:35.438357 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:35.438740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:35.441075 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Checking segment: {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:35.441680 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.442124 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Bound using segment: {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:35.444042 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Bound port: bcc33710-f3d9-4f03-8973-7059a54c1e11, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:35.444530 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.452076 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:35.492793 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.543823 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-cd68125a-6e5f-4351-990b-199e724d0689 service neutron] 10.222.0.81 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.9282017
Jun 01 12:34:35.566180 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54574) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:35.656291 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.735826 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] For port bcc33710-f3d9-4f03-8973-7059a54c1e11, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:35.750686 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:35.751186 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] For port bcc33710-f3d9-4f03-8973-7059a54c1e11, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=bcc33710-f3d9-4f03-8973-7059a54c1e11,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:35.759897 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.761963 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Usage tracker for resource:security_group_rule and tenant:e51364b73d3f468485c09eac109820a2 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:35.772673 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.773939 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:35.777367 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.789184 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:35.797599 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:35.805541 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:35.838853 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0cca3a8a-9819-42bd-8ceb-eaa6dfa5ae33,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:35.855647 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:35.863352 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:35.872154 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4834769
Jun 01 12:34:35.877062 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54580) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:35.900739 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'security_group_rule': {'security_group_id': '5b099188-b099-49ba-b755-aea87c47873e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:35.925983 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:35.954812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group_rule and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:35.968193 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:35.991544 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:36.053531 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.108764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.120055 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.219769 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c1f5d4-2aa1-4a62-9636-110a37430640 None None] Pushing event updated for resources: {'Port': ['ID=bcc33710-f3d9-4f03-8973-7059a54c1e11,revision_number=4']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:36.245641 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-f4c1f5d4-2aa1-4a62-9636-110a37430640 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.441s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:36.253088 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23281ab6-e3ee-4409-a58f-f545369277b7 None None] Pushing event updated for resources: {'Port': ['ID=c41297e3-3729-4961-8e43-0de027b9fe9f,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:36.273525 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-23281ab6-e3ee-4409-a58f-f545369277b7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.857s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:36.295307 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Routers {'4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:36.297484 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:36.303674 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d63670>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:36.311946 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4cc356bd-7daa-4c72-923b-af0a698f4790 req-e428b765-16c9-48f6-8214-b0e8d3985d1a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 210 time: 0.1365697
Jun 01 12:34:36.370983 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.375292 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.377179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:36.469576 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Attempting to bind port c41297e3-3729-4961-8e43-0de027b9fe9f on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:36.470581 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Attempting to bind port c41297e3-3729-4961-8e43-0de027b9fe9f by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:36.470884 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=38532ecf-bff6-4463-bf61-a051663b038e,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:36.475695 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:36.476442 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Attempting to bind port c41297e3-3729-4961-8e43-0de027b9fe9f on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:36.490326 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54610) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:36.491966 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:36.495186 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e51364b73d3f468485c09eac109820a2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9274464
Jun 01 12:34:36.495803 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Checking segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:36.496378 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.501031 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Bound using segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:36.501760 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Bound port: c41297e3-3729-4961-8e43-0de027b9fe9f, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:36.502352 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.519550 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=460fa9b7-f19e-4dec-bc99-471a1c60a896,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:36.525547 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:36.648704 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.652716 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.7728682
Jun 01 12:34:36.657660 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54616) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:36.678887 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:36.718498 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:36.769887 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:floatingip and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:36.795865 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:36.831220 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:36.839097 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.862752 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] For port c41297e3-3729-4961-8e43-0de027b9fe9f, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:36.873866 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] For port c41297e3-3729-4961-8e43-0de027b9fe9f, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=c41297e3-3729-4961-8e43-0de027b9fe9f,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:36.886601 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:36.898103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7d985de0-a0f1-4af1-a28a-e3b7d4fe418b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:36.937503 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:37.009091 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 54634) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:37.087945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:37.123639 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] Set router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:37.171931 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:34:37.172601 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d97520>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:34:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:37.254098 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:37.342691 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:37.422764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4657da3-4790-45a4-8abe-5ca46f2200e7 req-fb46969a-a896-4e72-9b64-f24bce73364b tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:37.423504 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-d4657da3-4790-45a4-8abe-5ca46f2200e7 req-fb46969a-a896-4e72-9b64-f24bce73364b tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Synchronizing usage tracker for tenant:ac8957d6acd0419f9863ee5fadc5649b on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:37.434129 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.db.resource_extend [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 12:34:37.572902 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device bcc33710-f3d9-4f03-8973-7059a54c1e11 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:37.603721 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:37.620548 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-91fab539-b4a6-4b9c-98b7-86345fffad7f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:37.698324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-d4657da3-4790-45a4-8abe-5ca46f2200e7 req-fb46969a-a896-4e72-9b64-f24bce73364b tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Unset dirty status for tenant:ac8957d6acd0419f9863ee5fadc5649b on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:37.699488 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4657da3-4790-45a4-8abe-5ca46f2200e7 req-fb46969a-a896-4e72-9b64-f24bce73364b tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 932 time: 0.8436596
Jun 01 12:34:37.716035 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Usage tracker for resource:security_group_rule and tenant:2ccdf2adc7b04334a2056ee980a24827 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:37.739763 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:37.771077 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23281ab6-e3ee-4409-a58f-f545369277b7 None None] Pushing event updated for resources: {'Port': ['ID=c41297e3-3729-4961-8e43-0de027b9fe9f,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:37.821936 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-23281ab6-e3ee-4409-a58f-f545369277b7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.924s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:37.851209 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=460fa9b7-f19e-4dec-bc99-471a1c60a896,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:37.866914 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:37.876726 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:37.888795 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ce676d5b-517e-484e-a826-9939cb57df33 {{(pid=91978) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:34:37.923926 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:37.997279 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4657da3-4790-45a4-8abe-5ca46f2200e7 req-f6fe6c77-dd1a-4da2-b584-78d72fa1fb19 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2761147
Jun 01 12:34:38.047309 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.provisioning_blocks [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Transition to ACTIVE for port object ce676d5b-517e-484e-a826-9939cb57df33 will not be triggered until provisioned by entity L2. {{(pid=91978) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:38.056567 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:38.090532 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:38.103721 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d63670>, [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 4, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'bcc33710-f3d9-4f03-8973-7059a54c1e11', 'name': '', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'mac_address': 'fa:16:3e:ab:15:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:24Z', 'updated_at': '2021-06-01T12:34:35Z', 'revision_number': 4, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'subnets': [{'id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:38.117389 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1be3fd2-cee7-4f52-b612-bdca26570aa5 None None] The sync data for ids ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'] in dv-cinder-793515-2-iscsi is: [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:25Z', 'revision_number': 4, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'bcc33710-f3d9-4f03-8973-7059a54c1e11', 'name': '', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'mac_address': 'fa:16:3e:ab:15:58', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:24Z', 'updated_at': '2021-06-01T12:34:35Z', 'revision_number': 4, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'subnets': [{'id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:34:38.226398 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:34:38.251946 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:38.261443 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/460fa9b7-f19e-4dec-bc99-471a1c60a896 HTTP/1.1" status: 204  len: 168 time: 1.7669663
Jun 01 12:34:38.526211 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-d1339bf2-0811-40ba-91b5-963bd407565e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:38.537149 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-d1339bf2-0811-40ba-91b5-963bd407565e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 819 time: 0.9837422
Jun 01 12:34:38.595449 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-6d430db6-ceec-4f42-9bad-70128310b9c0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/quotas/5bf4a909afd242fab0afa824fd49eade HTTP/1.1" status: 200  len: 375 time: 0.0570307
Jun 01 12:34:38.671141 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port bcc33710-f3d9-4f03-8973-7059a54c1e11 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:38.710771 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port bcc33710-f3d9-4f03-8973-7059a54c1e11 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:38.719785 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:38.779138 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Pushing event updated for resources: {'Port': ['ID=ce676d5b-517e-484e-a826-9939cb57df33,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:38.797414 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.707s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:38.830299 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.managers [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Attempting to bind port ce676d5b-517e-484e-a826-9939cb57df33 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:38.832127 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.managers [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Attempting to bind port ce676d5b-517e-484e-a826-9939cb57df33 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '1a6e7042-c02d-4865-b6a5-545f1bab5372', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 786, 'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d'}] {{(pid=91978) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:38.833575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Attempting to bind port ce676d5b-517e-484e-a826-9939cb57df33 on network 53a16a0a-0d86-46d5-81e4-dff69599238d {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:38.857771 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Port ce676d5b-517e-484e-a826-9939cb57df33 on network 53a16a0a-0d86-46d5-81e4-dff69599238d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:34:38.858390 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Attempting to bind port ce676d5b-517e-484e-a826-9939cb57df33 on network 53a16a0a-0d86-46d5-81e4-dff69599238d {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:38.876835 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:38.877561 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Checking segment: {'id': '1a6e7042-c02d-4865-b6a5-545f1bab5372', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 786, 'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:38.879874 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Bound using segment: {'id': '1a6e7042-c02d-4865-b6a5-545f1bab5372', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 786, 'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d'} {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:38.880865 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.managers [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Bound port: ce676d5b-517e-484e-a826-9939cb57df33, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1a6e7042-c02d-4865-b6a5-545f1bab5372', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 786, 'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d'}}] {{(pid=91978) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:38.882304 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:38.948239 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:38.981222 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:38.983391 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:39.210927 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9c339f1c-9ce0-4633-a094-4c2a5d2dba8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:39.303697 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-d0a9f083-1801-471c-8aa5-5bdae95a1333 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&fields=id HTTP/1.1" status: 200  len: 255 time: 0.7070796
Jun 01 12:34:39.340293 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] For port ce676d5b-517e-484e-a826-9939cb57df33, host hv-cinder-79351, cleared binding levels {{(pid=91978) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:39.404066 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] For port ce676d5b-517e-484e-a826-9939cb57df33, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=ce676d5b-517e-484e-a826-9939cb57df33,segment=NetworkSegment(1a6e7042-c02d-4865-b6a5-545f1bab5372),segment_id=1a6e7042-c02d-4865-b6a5-545f1bab5372)] {{(pid=91978) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:39.415364 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:39.424362 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:39.474638 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df3bd5bc-3773-4dd7-a51c-32031b295c55,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:39.543552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:39.558587 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 54702) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:39.559172 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2ccdf2adc7b04334a2056ee980a24827&name=default HTTP/1.1" status: 200  len: 2979 time: 2.5477593
Jun 01 12:34:39.611874 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:39.631975 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:39.638644 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] 10.222.0.95 "PUT /v2.0/ports/ce676d5b-517e-484e-a826-9939cb57df33 HTTP/1.1" status: 200  len: 1094 time: 6.2750075
Jun 01 12:34:39.640796 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:39.656927 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'tag': 'ce676d5b-517e-484e-a826-9939cb57df33'}] {{(pid=91978) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:34:39.915510 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port bcc33710-f3d9-4f03-8973-7059a54c1e11, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=bcc33710-f3d9-4f03-8973-7059a54c1e11,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:39.940656 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:39.997075 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e5fcfe8b-4fea-46e9-af0f-994864118677 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:40.077847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.95', 56347) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:40.196357 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23b941e3-140d-48b8-b74c-d3e3d075f15c req-e0601983-f2d2-4e1e-b99a-670ad0ec9014 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:40.221050 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-23b941e3-140d-48b8-b74c-d3e3d075f15c req-e0601983-f2d2-4e1e-b99a-670ad0ec9014 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 1.0233312
Jun 01 12:34:40.479155 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:40.491175 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-30f4721a-8472-4106-85a4-3faaf845adcf tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:40.493414 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-30f4721a-8472-4106-85a4-3faaf845adcf tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 819 time: 0.3555901
Jun 01 12:34:40.541672 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-54845eec-4027-4f08-9a89-7cc3a66dc913 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:40.541841 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Request body: {'port': {'device_id': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'admin_state_up': True, 'tenant_id': '5bf4a909afd242fab0afa824fd49eade'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:40.552620 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Pushing event updated for resources: {'Port': ['ID=ce676d5b-517e-484e-a826-9939cb57df33,revision_number=3']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:40.599431 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-23b941e3-140d-48b8-b74c-d3e3d075f15c req-a6a4e913-8e96-4598-bfcd-a7233119bddd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3772748
Jun 01 12:34:40.628024 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.204s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:40.645687 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-172f4d2f-6b26-4648-89e3-40b2dbf601a0 service neutron] 10.222.0.81 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.3405733
Jun 01 12:34:40.656068 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Allocated IP 172.27.3.247 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/0420406a-40b0-41f4-af1f-2b05286fa870) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:40.677222 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=bcc33710-f3d9-4f03-8973-7059a54c1e11,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:40.726181 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.733s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:40.733509 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d97520>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:36Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:34:40.745942 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de6945d1-44b7-4793-9f8d-1543e9c8c430 None None] The sync data for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi is: [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:36Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:34:40.751579 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08332f069cdff5b13479b061d6bbe376049db186f7bff4c04e61a4b86035db55" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e" -d '{"events": [{"name": "network-changed", "server_uuid": "8a67e00f-6966-4f2f-98ab-3e852efdbf7d", "tag": "ce676d5b-517e-484e-a826-9939cb57df33"}]}' {{(pid=91978) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:34:40.756271 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:40.806895 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-86af8c27-e85a-455b-b49d-d93759e4b37b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:40.808578 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-86af8c27-e85a-455b-b49d-d93759e4b37b service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=ac8957d6acd0419f9863ee5fadc5649b&device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 1097 time: 0.9195414
Jun 01 12:34:40.944115 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-bd6df351-726c-488c-b458-a6b4704531fa service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ce676d5b-517e-484e-a826-9939cb57df33 HTTP/1.1" status: 200  len: 217 time: 0.1231887
Jun 01 12:34:41.074313 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:41.099240 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0f1d8090-a9cb-41ef-9554-ca97f6e41c48 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:41.141968 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df3bd5bc-3773-4dd7-a51c-32031b295c55,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:41.159176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:41.163098 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:34:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c4b8e69-c0ce-407c-90a5-7be0c091f375 x-openstack-request-id: req-6c4b8e69-c0ce-407c-90a5-7be0c091f375 {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:34:41.165894 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8a67e00f-6966-4f2f-98ab-3e852efdbf7d", "tag": "ce676d5b-517e-484e-a826-9939cb57df33", "status": "completed", "code": 200}]} {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:34:41.166186 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-6c4b8e69-c0ce-407c-90a5-7be0c091f375 {{(pid=91978) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:34:41.166675 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'tag': 'ce676d5b-517e-484e-a826-9939cb57df33', 'status': 'completed', 'code': 200}
Jun 01 12:34:41.216543 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-eec456ee-af33-4861-a22f-ef5f797bf846 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:41.220205 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-eec456ee-af33-4861-a22f-ef5f797bf846 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=cdf0cb8d-bdfe-4594-b297-e53e395b7d22 HTTP/1.1" status: 200  len: 851 time: 0.2682080
Jun 01 12:34:41.225576 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:41.232151 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/df3bd5bc-3773-4dd7-a51c-32031b295c55 HTTP/1.1" status: 204  len: 168 time: 1.6629040
Jun 01 12:34:41.791274 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:41.860624 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-8f7c48c3-d285-41a8-9b7d-f740fb942e6b service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=53a16a0a-0d86-46d5-81e4-dff69599238d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2469060
Jun 01 12:34:42.074412 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:42.115273 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:42.182973 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-03e02343-efd4-41ff-8689-de7aba004a77 service neutron] 10.222.0.81 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 1.5243406
Jun 01 12:34:42.207871 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Made reservation on behalf of 5bf4a909afd242fab0afa824fd49eade for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:42.230198 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:42.354854 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:42.687346 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2adcf575-51da-43f0-a08e-82871ff1cbdf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:42.975495 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:43.052356 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:43.069045 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a181a812-73c6-4029-ac7b-582fc1507928 req-caecdd53-2ef1-4c12-9850-e2d91de10b23 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 210 time: 0.2918599
Jun 01 12:34:43.105233 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:43.127420 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device c41297e3-3729-4961-8e43-0de027b9fe9f up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:43.230443 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-1290c48a-36de-4266-bd87-f7c8239da76a service neutron] 10.222.0.95 "GET /v2.0/networks/53a16a0a-0d86-46d5-81e4-dff69599238d?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.3569908
Jun 01 12:34:43.299581 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:43.335732 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:43.396756 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port c41297e3-3729-4961-8e43-0de027b9fe9f completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:43.405354 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port c41297e3-3729-4961-8e43-0de027b9fe9f triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:43.406052 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:43.453446 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:43.765892 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2a34f68b-1559-4dc4-9198-400f418b7078 req-0b0a7674-0a38-49ec-b7db-d7ae8e246c31 service neutron] 10.222.0.95 "GET /v2.0/networks/53a16a0a-0d86-46d5-81e4-dff69599238d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4983840
Jun 01 12:34:43.797899 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'Port': ['ID=0420406a-40b0-41f4-af1f-2b05286fa870,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:43.826983 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.728s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:43.863200 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:43.882271 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Allocated IP 172.20.0.10 (5cafd137-be6a-4c7c-b850-6777e5242610/6295b8a8-665d-493b-bc88-f7898265e5fa/c612c626-62cb-4f01-863c-58dbaf411409) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:43.887442 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4835cdc6-dd5b-45fa-8d86-6d64bbe951d1 req-9695b43c-aa07-48b1-b7b6-7a7361651f87 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:43.890254 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:43.898285 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4835cdc6-dd5b-45fa-8d86-6d64bbe951d1 req-9695b43c-aa07-48b1-b7b6-7a7361651f87 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 0.7878146
Jun 01 12:34:43.922543 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:43.968566 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port c41297e3-3729-4961-8e43-0de027b9fe9f, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=c41297e3-3729-4961-8e43-0de027b9fe9f,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:43.981503 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:43.982672 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device bcc33710-f3d9-4f03-8973-7059a54c1e11 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:44.060120 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7d985de0-a0f1-4af1-a28a-e3b7d4fe418b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:44.301012 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:44.308735 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4835cdc6-dd5b-45fa-8d86-6d64bbe951d1 req-e242a168-4151-4088-995d-5fd101f66540 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2605305
Jun 01 12:34:44.320452 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-9c0280d4-b360-48be-b94e-d011c2e1d0c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:44.325658 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-9c0280d4-b360-48be-b94e-d011c2e1d0c5 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=ac8957d6acd0419f9863ee5fadc5649b&device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 1097 time: 0.4217196
Jun 01 12:34:44.469240 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=c41297e3-3729-4961-8e43-0de027b9fe9f,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:44.486516 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.426s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:44.489857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port bcc33710-f3d9-4f03-8973-7059a54c1e11 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:44.490596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:44.826210 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-13197f94-ebe3-49aa-97bd-8f8ec74f547c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:44.828488 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-13197f94-ebe3-49aa-97bd-8f8ec74f547c service neutron] 10.222.0.95 "GET /v2.0/networks?id=53a16a0a-0d86-46d5-81e4-dff69599238d HTTP/1.1" status: 200  len: 912 time: 0.4942586
Jun 01 12:34:44.858078 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device c41297e3-3729-4961-8e43-0de027b9fe9f up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:44.895025 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:44.944468 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:44.954993 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-441a9436-9d91-4bad-a633-8cc461160a77 req-f11576f6-be1f-43b6-a4fe-ef1e13d60b51 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 210 time: 0.4500368
Jun 01 12:34:44.991587 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9b9e1a74-ea3f-449f-bf64-1e06956035d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:45.055853 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Network 5cafd137-be6a-4c7c-b850-6777e5242610 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:45.067116 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:45.078693 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:45.084386 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:45.085028 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:45.184240 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port c41297e3-3729-4961-8e43-0de027b9fe9f triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:45.184970 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:45.185094 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-aa05ffb6-f259-4cd5-bec7-38a82a0d76d1 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ce676d5b-517e-484e-a826-9939cb57df33 HTTP/1.1" status: 200  len: 217 time: 0.3238766
Jun 01 12:34:45.271473 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Pushing event updated for resources: {'Port': ['ID=c612c626-62cb-4f01-863c-58dbaf411409,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:45.289133 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:45.446550 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-c4e67c2c-8c34-44e2-8ade-819033180936 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:45.451384 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 4.9309008
Jun 01 12:34:45.452051 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-c4e67c2c-8c34-44e2-8ade-819033180936 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=cdf0cb8d-bdfe-4594-b297-e53e395b7d22 HTTP/1.1" status: 200  len: 851 time: 0.2152212
Jun 01 12:34:45.465253 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.95', 56354) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:45.554526 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-86865fb8-915a-4917-810d-bfc98df32f61 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=53a16a0a-0d86-46d5-81e4-dff69599238d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0754905
Jun 01 12:34:45.576268 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:45.597472 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Request body: {'port': {'device_id': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:45.910231 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-3ea5ebea-1d68-4b36-9b42-5332be786dcf service neutron] 10.222.0.95 "GET /v2.0/networks/53a16a0a-0d86-46d5-81e4-dff69599238d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3355615
Jun 01 12:34:45.919946 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1539af61-1f87-4e1a-bdaa-21929dae4d24 req-19eeb01d-bc8b-4f1f-9fea-46d8b9614114 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:45.921808 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1539af61-1f87-4e1a-bdaa-21929dae4d24 req-19eeb01d-bc8b-4f1f-9fea-46d8b9614114 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 0.2900367
Jun 01 12:34:45.982421 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1539af61-1f87-4e1a-bdaa-21929dae4d24 req-afa21eaf-6ae9-41cc-a680-b0a55f59acd6 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501990
Jun 01 12:34:46.061176 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:46.092763 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:46.207934 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-2d664d34-235a-4c49-8179-043becf73c0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:46.371220 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:46.386599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-d6942c8a-59d9-42d4-81b6-b8e609624e51 req-a35b3c9d-6eea-4eb2-be47-0e5cc86488ce tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Synchronizing usage tracker for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:46.393293 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-8946520d-a30b-4876-9aff-4e981a10457a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:46.394732 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-8946520d-a30b-4876-9aff-4e981a10457a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 819 time: 0.9187629
Jun 01 12:34:46.402290 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:46.438764 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'Port': ['ID=0420406a-40b0-41f4-af1f-2b05286fa870,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:46.449943 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:46.478816 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:46.480136 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 9.8136435
Jun 01 12:34:46.505879 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-d6942c8a-59d9-42d4-81b6-b8e609624e51 req-a35b3c9d-6eea-4eb2-be47-0e5cc86488ce tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Unset dirty status for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:46.522305 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d6942c8a-59d9-42d4-81b6-b8e609624e51 req-a35b3c9d-6eea-4eb2-be47-0e5cc86488ce tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 210 time: 0.3076143
Jun 01 12:34:46.559975 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Request body: {'port': {'device_id': '43b63720-9350-4913-8f50-5662b9575005', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'admin_state_up': True, 'tenant_id': '5bf4a909afd242fab0afa824fd49eade'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:46.733191 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c34f9d53-afaf-4f70-b6d0-ce9edae0767e req-61ee6e6a-59c1-45f5-a183-a0109aa183b2 service neutron] 10.222.0.95 "GET /v2.0/networks/53a16a0a-0d86-46d5-81e4-dff69599238d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2179873
Jun 01 12:34:46.932891 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:46.937442 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-d463168d-4c1c-4115-aaac-16c9742af232 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:46.943510 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:46.959456 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Made reservation on behalf of 5bf4a909afd242fab0afa824fd49eade for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:46.963698 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-d463168d-4c1c-4115-aaac-16c9742af232 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:46.963847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:46.975732 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-d463168d-4c1c-4115-aaac-16c9742af232 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--830798424&fields=id&tenant_id=b09a17145ef0415faebc5bbdb71e3f3c HTTP/1.1" status: 200  len: 267 time: 0.0994906
Jun 01 12:34:47.226034 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-e365b1b7-472e-412e-9ffd-7be077ab1cc3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:47.229031 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-e365b1b7-472e-412e-9ffd-7be077ab1cc3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:network {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:47.271618 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-e365b1b7-472e-412e-9ffd-7be077ab1cc3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:network {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:47.273543 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-e365b1b7-472e-412e-9ffd-7be077ab1cc3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 810 time: 0.2969296
Jun 01 12:34:47.290996 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-45abe29c-f3e1-4ad4-b9be-e0e1d7cf58b1 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/quotas/b09a17145ef0415faebc5bbdb71e3f3c HTTP/1.1" status: 200  len: 375 time: 0.0106192
Jun 01 12:34:47.384887 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80b995f-e900-47ef-808f-045dcefa1f88 req-6f31f4a5-2210-4728-9c5c-3db1f9599c08 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:47.386417 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b80b995f-e900-47ef-808f-045dcefa1f88 req-6f31f4a5-2210-4728-9c5c-3db1f9599c08 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 0.1861112
Jun 01 12:34:47.421254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c612c626-62cb-4f01-863c-58dbaf411409 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:34:47.433166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:47.471066 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b80b995f-e900-47ef-808f-045dcefa1f88 req-6ad152e7-cae2-4319-99e2-a6ebdd199b80 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0752854
Jun 01 12:34:47.472106 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Transition to ACTIVE for port object c612c626-62cb-4f01-863c-58dbaf411409 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:47.500879 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-aeac9ac0-f548-410f-bac6-3305d886076a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1983485
Jun 01 12:34:47.511301 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:47.524764 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:47.671856 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55028) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:47.750338 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Allocated IP 172.20.0.8 (5cafd137-be6a-4c7c-b850-6777e5242610/6295b8a8-665d-493b-bc88-f7898265e5fa/d61046d2-ead3-4c6a-a151-93c1f0fc8249) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:47.777708 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-c2456292-b72b-4578-bab7-b536af3e8f07 service neutron] 10.222.0.81 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2636445
Jun 01 12:34:47.778299 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Pushing event updated for resources: {'Port': ['ID=c612c626-62cb-4f01-863c-58dbaf411409,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:47.785155 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-431d620f-73bd-42ba-90ad-a14f52599779 req-9d82d51f-afaa-4b43-b314-cfab25c0c878 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 210 time: 0.1070542
Jun 01 12:34:47.790806 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:47.823697 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Attempting to bind port c612c626-62cb-4f01-863c-58dbaf411409 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:47.824028 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Attempting to bind port c612c626-62cb-4f01-863c-58dbaf411409 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:47.824396 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Attempting to bind port c612c626-62cb-4f01-863c-58dbaf411409 on network 5cafd137-be6a-4c7c-b850-6777e5242610 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:47.842823 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Port c612c626-62cb-4f01-863c-58dbaf411409 on network 5cafd137-be6a-4c7c-b850-6777e5242610 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:34:47.843144 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Attempting to bind port c612c626-62cb-4f01-863c-58dbaf411409 on network 5cafd137-be6a-4c7c-b850-6777e5242610 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:47.861545 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:47.861981 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Checking segment: {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:47.862616 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Bound using segment: {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:47.863118 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Bound port: c612c626-62cb-4f01-863c-58dbaf411409, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:47.863459 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:47.954319 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55040) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:47.980257 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-fb70a953-b9ee-41e7-8338-8cd7fc720bbe service neutron] 10.222.0.81 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1815374
Jun 01 12:34:48.083034 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.097428 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.141396 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:48.146615 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] For port c612c626-62cb-4f01-863c-58dbaf411409, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:48.149461 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:48.155654 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Usage tracker for resource:security_group_rule and tenant:276b4f58e01f4041976dfb972160246a is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:48.167396 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Usage tracker for resource:security_group_rule and tenant:d6a60bec90b64d56b93c1e40e2c917ee is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:48.178153 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:48.184045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:48.194934 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:48.200171 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:48.202897 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] For port c612c626-62cb-4f01-863c-58dbaf411409, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=c612c626-62cb-4f01-863c-58dbaf411409,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:48.259548 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.285766 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-9d5b409d-e181-4395-b523-5a0118cf3292 req-2c6d849a-8d51-474d-9c1a-e71b5e2f4f04 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:48.290155 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.296305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:48.481069 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:48.481749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.483318 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] 10.222.0.95 "PUT /v2.0/ports/c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 200  len: 1094 time: 2.9950318
Jun 01 12:34:48.485151 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'tag': 'c612c626-62cb-4f01-863c-58dbaf411409'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:34:48.594462 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-9d5b409d-e181-4395-b523-5a0118cf3292 req-2c6d849a-8d51-474d-9c1a-e71b5e2f4f04 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:48.595606 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9d5b409d-e181-4395-b523-5a0118cf3292 req-2c6d849a-8d51-474d-9c1a-e71b5e2f4f04 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.3984444
Jun 01 12:34:48.655091 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Pushing event updated for resources: {'Port': ['ID=c612c626-62cb-4f01-863c-58dbaf411409,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:48.658462 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.362s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:48.713250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.732622 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.736114 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:48.749670 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69fbffcc-9dc3-4df6-93bc-024f99b3abe9 req-2830a0fc-a397-4194-9077-13c7b85cfb9f tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:48.751140 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-69fbffcc-9dc3-4df6-93bc-024f99b3abe9 req-2830a0fc-a397-4194-9077-13c7b85cfb9f tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 0.1102118
Jun 01 12:34:48.766800 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8ffd482-0cb5-404a-bb1e-79a76802fd02" -d '{"events": [{"name": "network-changed", "server_uuid": "9667206d-ce8b-4b7f-bacb-a9e2fed82b66", "tag": "c612c626-62cb-4f01-863c-58dbaf411409"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:34:48.780201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.781279 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.801509 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-69fbffcc-9dc3-4df6-93bc-024f99b3abe9 req-4cbfe4d6-4bcd-4413-b678-d8ce19d88bd2 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439737
Jun 01 12:34:48.811534 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.826358 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Network 5cafd137-be6a-4c7c-b850-6777e5242610 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:48.838751 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:48.848061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:48.853411 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:48.854011 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:48.890208 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d6a60bec90b64d56b93c1e40e2c917ee&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9313531
Jun 01 12:34:48.891096 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Pushing event updated for resources: {'Port': ['ID=d61046d2-ead3-4c6a-a151-93c1f0fc8249,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:48.893926 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55100) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:48.899761 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:48.904497 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=276b4f58e01f4041976dfb972160246a&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2298844
Jun 01 12:34:48.904497 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a9c62090-fd61-4d11-9de6-daa4834ebcd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.091s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:48.905556 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55104) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:48.955274 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:34:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74f40ef7-5fe8-4222-88da-477915199465 x-openstack-request-id: req-74f40ef7-5fe8-4222-88da-477915199465 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:34:48.955522 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9667206d-ce8b-4b7f-bacb-a9e2fed82b66", "tag": "c612c626-62cb-4f01-863c-58dbaf411409", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:34:48.955799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-74f40ef7-5fe8-4222-88da-477915199465 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:34:48.956227 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'tag': 'c612c626-62cb-4f01-863c-58dbaf411409', 'status': 'completed', 'code': 200}
Jun 01 12:34:48.978150 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc9fd85-35e8-4dd5-98ad-e1ac447f2bf0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=31c531f1-bca7-43de-ab7b-6ac5c045c8ca,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:48.992046 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.4605451
Jun 01 12:34:49.025941 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4643e271-05ef-4240-b3ca-59bd37dd9bee,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:49.030187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:49.030598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.193s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:49.030874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:49.031634 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.052446 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.059025 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.087111 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fd4d2d-e1dd-4cf9-aa61-30fe1b762825 req-2f63f563-e3c1-41f6-b5d2-4d20542f32c5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:49.088593 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b1fd4d2d-e1dd-4cf9-aa61-30fe1b762825 req-2f63f563-e3c1-41f6-b5d2-4d20542f32c5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 931 time: 0.1490579
Jun 01 12:34:49.092929 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.112907 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.117760 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:49.130835 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=31c531f1-bca7-43de-ab7b-6ac5c045c8ca,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:49.133537 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:49.135669 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.139142 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/31c531f1-bca7-43de-ab7b-6ac5c045c8ca HTTP/1.1" status: 204  len: 168 time: 0.2399364
Jun 01 12:34:49.171593 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-b1fd4d2d-e1dd-4cf9-aa61-30fe1b762825 req-be007f1f-0fbf-4f7a-982b-6b59fc8c0da4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Synchronizing usage tracker for tenant:5bf4a909afd242fab0afa824fd49eade on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:49.191713 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-b1fd4d2d-e1dd-4cf9-aa61-30fe1b762825 req-be007f1f-0fbf-4f7a-982b-6b59fc8c0da4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Unset dirty status for tenant:5bf4a909afd242fab0afa824fd49eade on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:49.193064 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b1fd4d2d-e1dd-4cf9-aa61-30fe1b762825 req-be007f1f-0fbf-4f7a-982b-6b59fc8c0da4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0822113
Jun 01 12:34:49.194075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.199604 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5fb09fc6-f789-4c3b-a5c3-8ed70c16de8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:49.218248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4643e271-05ef-4240-b3ca-59bd37dd9bee,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:49.220870 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:49.222079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.223209 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4643e271-05ef-4240-b3ca-59bd37dd9bee HTTP/1.1" status: 204  len: 168 time: 0.3165298
Jun 01 12:34:49.446423 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55120) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:49.463726 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.478428 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:49.482585 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Usage tracker for resource:security_group_rule and tenant:1dac90d1a6724bf58391e6654fb9222a is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:49.485401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:49.491328 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:49.579303 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.583543 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.592886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9339948e-28a5-43a4-b16d-6583a196ce88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:49.634236 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=1dac90d1a6724bf58391e6654fb9222a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1843119
Jun 01 12:34:49.634236 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb915f8f-9af3-4859-9897-41f629e9c956,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:49.635680 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:49.636407 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55128) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:49.657185 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55132) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:49.672472 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.689614 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:49.694111 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Usage tracker for resource:security_group_rule and tenant:0e6a8eb5015c424cbb91c753f2620819 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:49.697846 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:49.704907 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:49.726421 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.763502 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.805659 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.810196 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.823032 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-872ef1fc-f016-44db-9f86-b4a77ee98285 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:49.825267 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc06f0b7-0fab-4a19-aa57-120f301083b1 req-626414b1-cedc-44a3-9798-0340f844680f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.0543835
Jun 01 12:34:49.873973 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0e6a8eb5015c424cbb91c753f2620819&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2216208
Jun 01 12:34:49.876150 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55146) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:49.890108 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95609d68-58d1-4351-888e-e6967b856f9d,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:49.895191 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.895818 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:49.902196 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-2a13442c-1dfe-4ce7-84f6-1ec6a0165346 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:49.917153 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb915f8f-9af3-4859-9897-41f629e9c956,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:49.920806 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:49.923321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:49.924432 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/eb915f8f-9af3-4859-9897-41f629e9c956 HTTP/1.1" status: 204  len: 168 time: 0.2869840
Jun 01 12:34:49.962213 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Request body: {'port': {'device_id': '43b63720-9350-4913-8f50-5662b9575005', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:50.052188 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.085420 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.154578 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba863a5e-b556-4dce-8ab4-879537ca8dbc req-f64a21d3-e6f9-4893-b63c-d4e71f6f27d2 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:50.156282 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ba863a5e-b556-4dce-8ab4-879537ca8dbc req-f64a21d3-e6f9-4893-b63c-d4e71f6f27d2 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 0.2070045
Jun 01 12:34:50.163305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.182879 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ffd482-0cb5-404a-bb1e-79a76802fd02 req-8e62fd88-18b1-4248-9806-f084a2839470 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:50.184821 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f8ffd482-0cb5-404a-bb1e-79a76802fd02 req-8e62fd88-18b1-4248-9806-f084a2839470 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1097 time: 0.1866562
Jun 01 12:34:50.215053 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.245727 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:50.290141 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ba863a5e-b556-4dce-8ab4-879537ca8dbc req-1408834c-8fbf-4e71-9661-619dbe3f5a1e tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1220038
Jun 01 12:34:50.291948 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95609d68-58d1-4351-888e-e6967b856f9d,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:50.313480 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:50.329521 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.330605 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/95609d68-58d1-4351-888e-e6967b856f9d HTTP/1.1" status: 204  len: 168 time: 0.4529016
Jun 01 12:34:50.489962 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55166) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:50.626587 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ffd482-0cb5-404a-bb1e-79a76802fd02 req-54f304cd-c78f-407b-be66-87660a8e38b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:50.628113 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f8ffd482-0cb5-404a-bb1e-79a76802fd02 req-54f304cd-c78f-407b-be66-87660a8e38b9 service neutron] 10.222.0.95 "GET /v2.0/networks?tenant_id=5bf4a909afd242fab0afa824fd49eade&shared=False HTTP/1.1" status: 200  len: 920 time: 0.4082568
Jun 01 12:34:50.665407 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd76421-b2f7-4efe-b2a2-6d06447d1775 req-13eb6a4f-d5d6-4872-acf5-4f7c2b3ff1f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:50.666191 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ecd76421-b2f7-4efe-b2a2-6d06447d1775 req-13eb6a4f-d5d6-4872-acf5-4f7c2b3ff1f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Synchronizing usage tracker for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:50.682380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.697365 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:50.701428 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Usage tracker for resource:security_group_rule and tenant:08f2cd94af464572a7d2110f4cc601a7 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:50.705300 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:50.711833 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:50.729579 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ecd76421-b2f7-4efe-b2a2-6d06447d1775 req-13eb6a4f-d5d6-4872-acf5-4f7c2b3ff1f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Unset dirty status for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:50.736905 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ecd76421-b2f7-4efe-b2a2-6d06447d1775 req-13eb6a4f-d5d6-4872-acf5-4f7c2b3ff1f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 931 time: 0.3541751
Jun 01 12:34:50.782080 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55180) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:50.812564 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.819279 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ecd76421-b2f7-4efe-b2a2-6d06447d1775 req-1a694347-d654-4367-9210-82b86a3e78d2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0810680
Jun 01 12:34:50.834901 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:50.841754 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Usage tracker for resource:security_group_rule and tenant:0536dbf068104189933eeb676872b755 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:50.847332 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:50.851125 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.855115 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:50.869079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.883345 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e1967a9b-0d40-4c50-9c0e-4f7fb4152773 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:50.900237 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d61046d2-ead3-4c6a-a151-93c1f0fc8249 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:34:50.910755 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.932099 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Transition to ACTIVE for port object d61046d2-ead3-4c6a-a151-93c1f0fc8249 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:50.937850 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=08f2cd94af464572a7d2110f4cc601a7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4468369
Jun 01 12:34:50.939062 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:50.941476 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a3beb7c6-2e17-45b6-9714-c83aa65c4366,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:50.944003 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55188) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:50.949485 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:50.963764 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:51.058321 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.060943 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.074851 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.089330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:51.132208 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Pushing event updated for resources: {'Port': ['ID=d61046d2-ead3-4c6a-a151-93c1f0fc8249,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:51.161067 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.169422 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:51.201790 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-67318cfb-2b33-4981-88d3-c9ddce442abc req-ea54deec-11b1-44c3-b231-54ee0b9073ba tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.0999033
Jun 01 12:34:51.202079 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Attempting to bind port d61046d2-ead3-4c6a-a151-93c1f0fc8249 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:34:51.202553 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Attempting to bind port d61046d2-ead3-4c6a-a151-93c1f0fc8249 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:34:51.203153 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Attempting to bind port d61046d2-ead3-4c6a-a151-93c1f0fc8249 on network 5cafd137-be6a-4c7c-b850-6777e5242610 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:51.210819 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Port d61046d2-ead3-4c6a-a151-93c1f0fc8249 on network 5cafd137-be6a-4c7c-b850-6777e5242610 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:34:51.211189 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Attempting to bind port d61046d2-ead3-4c6a-a151-93c1f0fc8249 on network 5cafd137-be6a-4c7c-b850-6777e5242610 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:34:51.216843 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=477fa1d1-7f91-4abb-85ce-6793289a2d57,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:51.218918 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:34:51.219438 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Checking segment: {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:34:51.220012 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Bound using segment: {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:34:51.221236 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Bound port: d61046d2-ead3-4c6a-a151-93c1f0fc8249, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1396a8b0-159e-40ec-9e21-d81bb2064dbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 790, 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:34:51.221758 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.225066 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0536dbf068104189933eeb676872b755&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4397371
Jun 01 12:34:51.225066 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:51.231566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55200) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:51.302094 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.310024 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:51.326511 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3beb7c6-2e17-45b6-9714-c83aa65c4366,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:51.329006 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.331511 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:51.350295 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] For port d61046d2-ead3-4c6a-a151-93c1f0fc8249, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:34:51.357187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] For port d61046d2-ead3-4c6a-a151-93c1f0fc8249, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:34:51.362384 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.363649 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a3beb7c6-2e17-45b6-9714-c83aa65c4366 HTTP/1.1" status: 204  len: 168 time: 0.4169865
Jun 01 12:34:51.379326 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.383541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.399783 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:51.455535 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.460490 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:51.471418 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=477fa1d1-7f91-4abb-85ce-6793289a2d57,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:51.476409 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:51.478886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.490916 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/477fa1d1-7f91-4abb-85ce-6793289a2d57 HTTP/1.1" status: 204  len: 168 time: 0.2581341
Jun 01 12:34:51.578162 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:51.579028 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.580401 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] 10.222.0.95 "PUT /v2.0/ports/d61046d2-ead3-4c6a-a151-93c1f0fc8249 HTTP/1.1" status: 200  len: 1093 time: 1.6235108
Jun 01 12:34:51.580873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '43b63720-9350-4913-8f50-5662b9575005', 'tag': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:34:51.583100 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f683c861-5512-40d5-bca9-e851c77aaccf" -d '{"events": [{"name": "network-changed", "server_uuid": "43b63720-9350-4913-8f50-5662b9575005", "tag": "d61046d2-ead3-4c6a-a151-93c1f0fc8249"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:34:51.637448 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Pushing event updated for resources: {'Port': ['ID=d61046d2-ead3-4c6a-a151-93c1f0fc8249,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:51.641440 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:51.649696 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:34:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac306571-0b95-4369-af8c-09662a7898d4 x-openstack-request-id: req-ac306571-0b95-4369-af8c-09662a7898d4 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:34:51.650002 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "43b63720-9350-4913-8f50-5662b9575005", "tag": "d61046d2-ead3-4c6a-a151-93c1f0fc8249", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:34:51.650387 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-ac306571-0b95-4369-af8c-09662a7898d4 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:34:51.650824 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '43b63720-9350-4913-8f50-5662b9575005', 'tag': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249', 'status': 'completed', 'code': 200}
Jun 01 12:34:51.673785 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d9294b-ebbe-4039-878c-a9781836d335 req-f133fdc4-70f5-4f0c-97a0-e8ae84a50df6 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:51.681104 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-88d9294b-ebbe-4039-878c-a9781836d335 req-f133fdc4-70f5-4f0c-97a0-e8ae84a50df6 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 0.1535165
Jun 01 12:34:51.723222 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-88d9294b-ebbe-4039-878c-a9781836d335 req-4eb745b9-31e1-40f4-bc26-cfdd28cf73d1 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411406
Jun 01 12:34:51.878852 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55226) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:51.900287 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:51.915870 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:51.919809 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Usage tracker for resource:security_group_rule and tenant:c0a8a919f4544def8d34a5f1e65516ed is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:51.923322 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:51.930591 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:52.030792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:52.036156 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:52.045973 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86588110-880c-4d55-b6d6-91ebc041dd86 req-b6dc5f73-e83c-4660-ad49-ae66b97002ca tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:52.046412 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-de573cc5-4cb7-423a-97a9-ae05acaada23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:52.051084 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-86588110-880c-4d55-b6d6-91ebc041dd86 req-b6dc5f73-e83c-4660-ad49-ae66b97002ca tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.1107295
Jun 01 12:34:52.094637 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c0a8a919f4544def8d34a5f1e65516ed&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2146428
Jun 01 12:34:52.095405 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c9b6157-2e1c-4a15-879c-e11da7b47a20,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:52.096950 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55236) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:52.098458 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:52.110229 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-86588110-880c-4d55-b6d6-91ebc041dd86 req-5c15e19f-06aa-4ad6-89d6-d38c25f980d5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0582521
Jun 01 12:34:52.189868 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:52.219463 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:52.279542 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:52.284720 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:52.295764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c9b6157-2e1c-4a15-879c-e11da7b47a20,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:52.307299 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:52.309952 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:52.314414 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/8c9b6157-2e1c-4a15-879c-e11da7b47a20 HTTP/1.1" status: 204  len: 168 time: 0.2127264
Jun 01 12:34:52.377478 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0940809b-04af-4ee4-a7d5-1d00014d2b06 req-de7f1dd0-9e83-476f-b19b-3d1443585238 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.0585957
Jun 01 12:34:52.951806 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc1ef45-7936-4e61-829f-a3260f24d904 req-c9a9c767-9059-4652-8504-0dab6e335ba6 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:52.957001 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7fc1ef45-7936-4e61-829f-a3260f24d904 req-c9a9c767-9059-4652-8504-0dab6e335ba6 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 944 time: 0.0969088
Jun 01 12:34:53.001362 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7fc1ef45-7936-4e61-829f-a3260f24d904 req-6333e75e-c4e0-468c-b280-f114d71027fe tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414274
Jun 01 12:34:53.349760 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2011bb3-9871-440c-ac9b-8da0c55ce5bf req-e783dec0-e35d-4c5b-93f3-5386ffe04c17 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:53.357048 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b2011bb3-9871-440c-ac9b-8da0c55ce5bf req-e783dec0-e35d-4c5b-93f3-5386ffe04c17 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.1132154
Jun 01 12:34:53.368159 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device ce676d5b-517e-484e-a826-9939cb57df33 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:34:53.555845 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port ce676d5b-517e-484e-a826-9939cb57df33, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=ce676d5b-517e-484e-a826-9939cb57df33,segment=NetworkSegment(1a6e7042-c02d-4865-b6a5-545f1bab5372),segment_id=1a6e7042-c02d-4865-b6a5-545f1bab5372)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:53.571994 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'ce676d5b-517e-484e-a826-9939cb57df33', 'network_id': '53a16a0a-0d86-46d5-81e4-dff69599238d', 'port_id': 'ce676d5b-517e-484e-a826-9939cb57df33', 'mac_address': 'fa:16:3e:ba:b5:37', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 786, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cdf0cb8d-bdfe-4594-b297-e53e395b7d22', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:34:53.649803 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:53.680587 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bee9e964-7e9e-4789-9512-1a5be2e4fbc4 req-42cc6ceb-1383-4cdd-934b-e53971bc1745 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.1098375
Jun 01 12:34:53.683093 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ce676d5b-517e-484e-a826-9939cb57df33 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:34:53.721111 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port ce676d5b-517e-484e-a826-9939cb57df33, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=ce676d5b-517e-484e-a826-9939cb57df33,segment=NetworkSegment(1a6e7042-c02d-4865-b6a5-545f1bab5372),segment_id=1a6e7042-c02d-4865-b6a5-545f1bab5372)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:53.736876 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:53.739278 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:53.839305 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b2011bb3-9871-440c-ac9b-8da0c55ce5bf req-773cfd16-611f-404d-b3fe-bcb99855a0a0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3921323
Jun 01 12:34:53.849449 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c861-5512-40d5-bca9-e851c77aaccf req-18f6e9f2-fa81-4236-ac82-e36b3861d035 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:53.852054 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f683c861-5512-40d5-bca9-e851c77aaccf req-18f6e9f2-fa81-4236-ac82-e36b3861d035 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 1096 time: 0.4538527
Jun 01 12:34:53.879378 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ffd482-0cb5-404a-bb1e-79a76802fd02 req-af37c3dd-6578-4f4e-8d11-0e40bbd2ef72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:53.881284 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f8ffd482-0cb5-404a-bb1e-79a76802fd02 req-af37c3dd-6578-4f4e-8d11-0e40bbd2ef72 service neutron] 10.222.0.95 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.5209138
Jun 01 12:34:53.911366 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=ce676d5b-517e-484e-a826-9939cb57df33,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:53.918397 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:54.210108 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a512c1c2-7163-4268-b080-e2cc19fe1b42 req-90903a8e-6425-4cef-a6c0-67951efd5017 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:54.212135 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a512c1c2-7163-4268-b080-e2cc19fe1b42 req-90903a8e-6425-4cef-a6c0-67951efd5017 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 945 time: 0.0943575
Jun 01 12:34:54.339116 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a512c1c2-7163-4268-b080-e2cc19fe1b42 req-28d1ca96-559e-4a9d-924b-35794bcdf2b6 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1211815
Jun 01 12:34:54.833475 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2a60106e-22c0-4a7b-997a-ed57ba7bc267 req-05246b55-7e3d-4c8c-9ac3-08ea8f93fd9d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.0516565
Jun 01 12:34:54.974986 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55390) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:55.007293 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55396) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:55.057311 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca115715-c7d0-4ba1-9054-ed3cca757ac3 req-a202b6d5-f880-46a5-a284-c2d4a8e3f328 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:55.059511 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca115715-c7d0-4ba1-9054-ed3cca757ac3 req-a202b6d5-f880-46a5-a284-c2d4a8e3f328 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.0944104
Jun 01 12:34:55.125091 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.130365 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca115715-c7d0-4ba1-9054-ed3cca757ac3 req-ea6731d3-c474-4cb6-ab98-2a5c90391639 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0649393
Jun 01 12:34:55.152615 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:55.158732 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Usage tracker for resource:security_group_rule and tenant:3e352ba2fefa4667bd3c015164ff969c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:55.174019 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:55.181325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.189886 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:55.207420 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:55.208355 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Usage tracker for resource:security_group_rule and tenant:522340ec3f184db6a9363a2273c6a37f is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:55.216736 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:55.225620 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:55.329676 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.340565 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.349154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7dc31f18-bd49-4158-8819-a9e7485b10b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:55.405230 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.407704 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb513a12-2e0a-4694-96c3-7dc5ad48524e,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:55.411806 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=3e352ba2fefa4667bd3c015164ff969c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4358201
Jun 01 12:34:55.412731 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:55.414295 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.415660 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55416) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:55.422256 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:55.463872 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=522340ec3f184db6a9363a2273c6a37f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4544287
Jun 01 12:34:55.473885 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55420) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:55.499981 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f57ce0a8-23a5-43cd-a49d-ca686b37da3a,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:55.505988 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:55.518864 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.547250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e98140-6ef8-43c8-85ea-b774fbef79fa req-348eef6b-7552-433f-b6c2-9ff294f22358 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:55.548771 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-00e98140-6ef8-43c8-85ea-b774fbef79fa req-348eef6b-7552-433f-b6c2-9ff294f22358 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 945 time: 0.0910351
Jun 01 12:34:55.570026 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.640478 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-00e98140-6ef8-43c8-85ea-b774fbef79fa req-2346bc25-f090-4f81-9029-510ff1aef481 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0845997
Jun 01 12:34:55.651805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.673602 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.680118 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:55.696098 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.701341 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb513a12-2e0a-4694-96c3-7dc5ad48524e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:55.712334 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:55.720575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.721659 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/fb513a12-2e0a-4694-96c3-7dc5ad48524e HTTP/1.1" status: 204  len: 168 time: 0.3050511
Jun 01 12:34:55.766538 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.771298 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-663ea9fc-6d02-45dd-9f05-11cc6d72128b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:55.781204 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f57ce0a8-23a5-43cd-a49d-ca686b37da3a,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:55.784560 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:55.787739 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:55.792536 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/f57ce0a8-23a5-43cd-a49d-ca686b37da3a HTTP/1.1" status: 204  len: 168 time: 0.3111131
Jun 01 12:34:55.997795 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c53a8b6d-698c-4633-b637-26ad2512f60e req-6bcdfbb9-f6a5-42d4-ae23-6f7eef2b4624 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.0512969
Jun 01 12:34:56.100821 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55440) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:56.119701 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.135543 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:56.139695 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Usage tracker for resource:security_group_rule and tenant:97f68ac5cf77422c9b6258efafb86b3c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:56.143907 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:56.150743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:56.192330 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55446) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:56.214509 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.236671 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:56.241021 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Usage tracker for resource:security_group_rule and tenant:5b46c2c7ca7940b982b3b6003cba0932 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:56.243902 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:56.250214 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:56.254979 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.259116 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.266239 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-827c03cc-1bbf-402c-b6d7-de4f4420f35b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:56.310160 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=97f68ac5cf77422c9b6258efafb86b3c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2080212
Jun 01 12:34:56.311019 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f11d7eb-8dde-4432-9b4f-cb9f207818a1,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:56.313239 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55450) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:56.315533 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:56.372394 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.375235 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b18afef1-795d-4b03-bb04-76277af40340 req-b7ffaa0d-0a78-4982-9602-986b0b36bd5b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:56.376725 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b18afef1-795d-4b03-bb04-76277af40340 req-b7ffaa0d-0a78-4982-9602-986b0b36bd5b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.1213751
Jun 01 12:34:56.400341 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.430102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.437944 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.448690 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:56.452091 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.456033 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d3e0f518-a515-4a30-85c3-f714e7cbea1a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:56.468886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f11d7eb-8dde-4432-9b4f-cb9f207818a1,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:56.470136 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b18afef1-795d-4b03-bb04-76277af40340 req-ce46d33c-59fe-46a9-869f-a203ff9389b9 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0825887
Jun 01 12:34:56.471734 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:56.473711 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.474794 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7f11d7eb-8dde-4432-9b4f-cb9f207818a1 HTTP/1.1" status: 204  len: 168 time: 0.1606288
Jun 01 12:34:56.509324 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5b46c2c7ca7940b982b3b6003cba0932&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3150373
Jun 01 12:34:56.510560 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78559776-4abd-4741-a4a6-78406edf50a7,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:56.512049 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55458) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:56.522749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:56.576571 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.609491 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.786279 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c861-5512-40d5-bca9-e851c77aaccf req-cfd53e89-d7bf-4a19-814f-c32d0b07b8a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:56.788120 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f683c861-5512-40d5-bca9-e851c77aaccf req-cfd53e89-d7bf-4a19-814f-c32d0b07b8a5 service neutron] 10.222.0.95 "GET /v2.0/networks?tenant_id=5bf4a909afd242fab0afa824fd49eade&shared=False HTTP/1.1" status: 200  len: 920 time: 0.1951752
Jun 01 12:34:56.819181 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['ce676d5b-517e-484e-a826-9939cb57df33'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:34:56.827834 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-a7ac623d-513d-4c2b-9c63-85e749b29679 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:56.829629 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-a7ac623d-513d-4c2b-9c63-85e749b29679 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1097 time: 0.1576633
Jun 01 12:34:56.837607 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:56.913322 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:57.013486 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-9dc43099-21e5-4bdb-bcb9-ff5a2c43587f service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 200  len: 217 time: 0.1716106
Jun 01 12:34:57.014340 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78559776-4abd-4741-a4a6-78406edf50a7,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:57.020428 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:57.113146 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:57.114391 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/78559776-4abd-4741-a4a6-78406edf50a7 HTTP/1.1" status: 204  len: 168 time: 0.6013408
Jun 01 12:34:57.144864 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-1ab7d2dd-ea73-46c5-9781-fb52232c20bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:57.147206 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-1ab7d2dd-ea73-46c5-9781-fb52232c20bd service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.1249905
Jun 01 12:34:57.221831 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-48a75e52-7e1b-4d3e-ac61-3969732d6987 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0662599
Jun 01 12:34:57.268336 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d970fd82-2712-478e-ae7f-0fae190e235e req-3a04d0f0-3ef5-44c7-ac28-204b64e6e382 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:57.269964 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d970fd82-2712-478e-ae7f-0fae190e235e req-3a04d0f0-3ef5-44c7-ac28-204b64e6e382 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 945 time: 0.3403645
Jun 01 12:34:57.430844 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d970fd82-2712-478e-ae7f-0fae190e235e req-715acd89-eaba-4b93-b717-94504eb5ac61 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0974309
Jun 01 12:34:57.453111 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-dc04dd2c-344c-4bc7-a501-f45e674fa2bb tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:57.459393 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-dc04dd2c-344c-4bc7-a501-f45e674fa2bb tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 810 time: 0.7035840
Jun 01 12:34:57.460604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c861-5512-40d5-bca9-e851c77aaccf req-be3f4175-4815-455f-a6a6-aba2656d7cb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:57.462432 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f683c861-5512-40d5-bca9-e851c77aaccf req-be3f4175-4815-455f-a6a6-aba2656d7cb9 service neutron] 10.222.0.95 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.6678398
Jun 01 12:34:57.463216 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-e3e81780-fb0b-430c-82d8-1036333ba51f service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2332382
Jun 01 12:34:57.526012 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-05c619e3-dd10-4690-a39e-133d7354bfe0 req-7910391e-e5c8-4b83-b4fd-f152a42dcd04 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.1681054
Jun 01 12:34:57.644325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-344dd254-a79e-469d-b7bc-d781899d6f4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:34:57.685646 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-344dd254-a79e-469d-b7bc-d781899d6f4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:34:57.685646 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-344dd254-a79e-469d-b7bc-d781899d6f4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b09a17145ef0415faebc5bbdb71e3f3c HTTP/1.1" status: 200  len: 379 time: 0.1984684
Jun 01 12:34:57.706244 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'port': {'device_id': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'admin_state_up': True, 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'security_groups': ['5b099188-b099-49ba-b755-aea87c47873e']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:57.861838 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-2f8fbbd3-8b67-4717-a08a-6e132d7a2c07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:57.865881 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-2f8fbbd3-8b67-4717-a08a-6e132d7a2c07 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 1096 time: 0.3338699
Jun 01 12:34:57.983046 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c16d54ff-5141-4320-8fd0-a67f0ad91bb3 req-ad614e38-fc5f-49b1-83c6-2eb67c62ab24 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5045419
Jun 01 12:34:58.012826 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b15072e2-fc48-4ab4-8b32-444977403e19 req-3d2befe4-b015-45fb-b33e-3111722cbb0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:58.020546 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b15072e2-fc48-4ab4-8b32-444977403e19 req-3d2befe4-b015-45fb-b33e-3111722cbb0d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.2728648
Jun 01 12:34:58.034298 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-cb0ebc7f-8884-4d6d-8bcd-dc9b08801f7c service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249 HTTP/1.1" status: 200  len: 217 time: 0.1595838
Jun 01 12:34:58.113654 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b15072e2-fc48-4ab4-8b32-444977403e19 req-cb28e9c0-6a26-4070-a55d-6b1777fee931 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0853970
Jun 01 12:34:58.152089 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:58.170597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-a11d508f-2c0d-4f82-9da2-677716ef37a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:58.175574 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-a11d508f-2c0d-4f82-9da2-677716ef37a1 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.1331408
Jun 01 12:34:58.176631 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:58.268800 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-3679989c-bfa0-47b0-b8dc-79033c59782e service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0793982
Jun 01 12:34:58.275631 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Made reservation on behalf of b09a17145ef0415faebc5bbdb71e3f3c for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:34:58.282912 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:58.317124 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device ce676d5b-517e-484e-a826-9939cb57df33 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:34:58.467006 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port ce676d5b-517e-484e-a826-9939cb57df33 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:58.477604 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port ce676d5b-517e-484e-a826-9939cb57df33 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:58.479025 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:58.675858 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-a15b7921-1ac1-4cff-898a-3f6bf4547a41 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3679738
Jun 01 12:34:58.717016 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:58.781175 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce676d5b-517e-484e-a826-9939cb57df33'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:34:58.845493 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-21d51b5d-42b8-4a73-874b-46957741e9b6 req-aa09ca20-7dbe-451e-96ac-88646f7d83aa service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1491661
Jun 01 12:34:58.859409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Allocated IP 172.20.0.6 (a43c69f6-c415-4ad5-8f5b-032eacaeb49e/98e949e5-17bf-4e08-a5ea-232517784814/173aae46-c6ad-4fa4-b7a3-a900710d3701) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:34:58.883235 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-15e23380-dca0-449e-8309-67f1a8b50ae5 req-b38c3c4b-1586-4d5f-ad3d-5953902b4156 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.1048608
Jun 01 12:34:58.907914 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d584525e-2096-4b74-8672-712e58d6aa4d req-795cfca2-ebc1-4208-83b9-b279ae6e7f11 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:58.909829 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d584525e-2096-4b74-8672-712e58d6aa4d req-795cfca2-ebc1-4208-83b9-b279ae6e7f11 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 945 time: 0.3253586
Jun 01 12:34:58.949299 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port ce676d5b-517e-484e-a826-9939cb57df33, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=ce676d5b-517e-484e-a826-9939cb57df33,segment=NetworkSegment(1a6e7042-c02d-4865-b6a5-545f1bab5372),segment_id=1a6e7042-c02d-4865-b6a5-545f1bab5372)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:34:58.962220 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:58.965985 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:59.060991 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d584525e-2096-4b74-8672-712e58d6aa4d req-047c0da3-9e94-45cc-b8d8-11fe83884473 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1435149
Jun 01 12:34:59.069820 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=ce676d5b-517e-484e-a826-9939cb57df33,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:59.073251 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:59.198191 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55612) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:59.235925 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:59.293470 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Transition to ACTIVE for port object 173aae46-c6ad-4fa4-b7a3-a900710d3701 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:34:59.359402 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:59.374803 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:34:59.434444 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986c1e1c-4a9a-4b3c-b18e-0b340f6930d9 req-b748f039-9786-4230-95cf-96ee1a3e6957 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:59.436570 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-986c1e1c-4a9a-4b3c-b18e-0b340f6930d9 req-b748f039-9786-4230-95cf-96ee1a3e6957 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.1102316
Jun 01 12:34:59.454747 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82317272-ada1-4e9b-a838-ec3667cc9a4e" -d '{"events": [{"server_uuid": "8a67e00f-6966-4f2f-98ab-3e852efdbf7d", "name": "network-vif-plugged", "status": "completed", "tag": "ce676d5b-517e-484e-a826-9939cb57df33"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:34:59.500260 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-986c1e1c-4a9a-4b3c-b18e-0b340f6930d9 req-3d3f8221-4667-4d20-b5f0-24ed64d9d8f4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0575995
Jun 01 12:34:59.546681 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:34:59.549364 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:34:59.553996 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:34:59.560161 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:34:59.560805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:59.569475 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'Port': ['ID=173aae46-c6ad-4fa4-b7a3-a900710d3701,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:34:59.578627 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:34:59.633806 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.9376633
Jun 01 12:34:59.660268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Request body: {'port': {'device_id': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:34:59.795686 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:59.801167 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55638) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:34:59.833123 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:59.854876 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:34:59.854876 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Usage tracker for resource:security_group_rule and tenant:2eee74a594af4d44965d0c041c8fc58c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:34:59.855786 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:34:59.866617 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:34:59.960438 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-da87387d-d76c-44d3-9224-e537934b396a None None] Provisioning for port 173aae46-c6ad-4fa4-b7a3-a900710d3701 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:34:59.969244 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-da87387d-d76c-44d3-9224-e537934b396a None None] Provisioning complete for port 173aae46-c6ad-4fa4-b7a3-a900710d3701 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:34:59.969794 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-da87387d-d76c-44d3-9224-e537934b396a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:59.982418 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:34:59.988861 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.028859 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:00.103106 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:34:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28d21ea8-278e-47b6-9c47-76d653647cc4 x-openstack-request-id: req-28d21ea8-278e-47b6-9c47-76d653647cc4 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:35:00.104618 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a67e00f-6966-4f2f-98ab-3e852efdbf7d", "name": "network-vif-plugged", "status": "completed", "tag": "ce676d5b-517e-484e-a826-9939cb57df33", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:35:00.104815 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.105237 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-28d21ea8-278e-47b6-9c47-76d653647cc4 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:35:00.105867 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce676d5b-517e-484e-a826-9939cb57df33', 'code': 200}
Jun 01 12:35:00.144586 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-da87387d-d76c-44d3-9224-e537934b396a None None] Port 173aae46-c6ad-4fa4-b7a3-a900710d3701 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:35:00.158140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:00.162079 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Usage tracker for resource:security_group_rule and tenant:5e534dc6cfd54b3cade555c70d325794 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:00.175885 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:00.188502 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:00.229443 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2eee74a594af4d44965d0c041c8fc58c&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0301180
Jun 01 12:35:00.237523 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55654) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:00.308752 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9e918c5-1539-4ddf-97fa-935042185239,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:00.311944 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:00.346481 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device c612c626-62cb-4f01-863c-58dbaf411409 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:35:00.355141 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.407741 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.431921 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c599cdf-65c3-4083-a95d-17754dfe77b3 req-b728bffe-4d71-4143-924b-7d0445269991 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:00.438139 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c599cdf-65c3-4083-a95d-17754dfe77b3 req-b728bffe-4d71-4143-924b-7d0445269991 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 931 time: 0.3725567
Jun 01 12:35:00.550058 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c599cdf-65c3-4083-a95d-17754dfe77b3 req-101c4b0c-05d5-4cd4-8ea2-f7a43a95ccbe tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1109517
Jun 01 12:35:00.569066 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port c612c626-62cb-4f01-863c-58dbaf411409, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=c612c626-62cb-4f01-863c-58dbaf411409,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:00.575466 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.584714 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-28b0122b-8484-44f8-b2b6-706e9185476f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:00.597066 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'c612c626-62cb-4f01-863c-58dbaf411409', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'port_id': 'c612c626-62cb-4f01-863c-58dbaf411409', 'mac_address': 'fa:16:3e:8d:6c:4a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 790, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:35:00.608347 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9e918c5-1539-4ddf-97fa-935042185239,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:00.612999 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:00.614467 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-235155a9-3dd0-4df9-bb0e-2300566a95fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:00.615795 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-235155a9-3dd0-4df9-bb0e-2300566a95fe service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 1099 time: 0.2448742
Jun 01 12:35:00.618377 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.620536 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/c9e918c5-1539-4ddf-97fa-935042185239 HTTP/1.1" status: 204  len: 168 time: 0.3711095
Jun 01 12:35:00.686936 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.700836 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.701202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.724013 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c612c626-62cb-4f01-863c-58dbaf411409 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:35:00.724996 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.744646 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port c612c626-62cb-4f01-863c-58dbaf411409, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=c612c626-62cb-4f01-863c-58dbaf411409,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:00.753883 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:00.756451 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:00.775484 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-60254d9e-17c8-4556-9733-b16bc92df8c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:00.791442 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31bfec01-d7d0-405f-914e-3cc09b9a4a87 req-111e6288-94ac-4f29-805b-385af17f900b tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:00.792989 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31bfec01-d7d0-405f-914e-3cc09b9a4a87 req-111e6288-94ac-4f29-805b-385af17f900b tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.4231601
Jun 01 12:35:00.845365 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:00.865351 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Usage tracker for resource:security_group_rule and tenant:e514b1b3a3c44b1fba238df8cf212874 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:00.878244 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=c612c626-62cb-4f01-863c-58dbaf411409,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:00.879895 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ad3c65-fb93-46d8-8693-762c3f434307 req-2d8df2b2-10e3-444c-9b6a-868253a0ce76 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:00.885015 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:00.889007 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:00.896602 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-68ad3c65-fb93-46d8-8693-762c3f434307 req-2d8df2b2-10e3-444c-9b6a-868253a0ce76 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.1194406
Jun 01 12:35:00.951989 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-68ad3c65-fb93-46d8-8693-762c3f434307 req-1d0e063d-7a85-4944-a227-5cd8ea75c3cd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0543044
Jun 01 12:35:00.959416 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:00.980303 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['c612c626-62cb-4f01-863c-58dbaf411409'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:35:00.986527 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 173aae46-c6ad-4fa4-b7a3-a900710d3701 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:35:01.000027 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5e534dc6cfd54b3cade555c70d325794&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1972289
Jun 01 12:35:01.000951 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f46bbb8e-cca6-4a65-abec-4e0b511f3e65,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:01.002995 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55696) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:01.004014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:01.011114 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.159960 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Transition to ACTIVE for port object 173aae46-c6ad-4fa4-b7a3-a900710d3701 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:35:01.166710 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.168530 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.169664 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.187454 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31bfec01-d7d0-405f-914e-3cc09b9a4a87 req-f96feac3-726a-48a9-9ba1-93c0a2349164 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3033533
Jun 01 12:35:01.187759 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55706) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:01.189788 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:01.242539 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.247497 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.268736 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.289986 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ccf04bb8-dad6-4119-af6a-ee38fcee7380 req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6597359
Jun 01 12:35:01.348403 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.352309 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d0e68a2c-92ba-46ad-9d27-e8abc539add7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:01.410577 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:01.412859 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f46bbb8e-cca6-4a65-abec-4e0b511f3e65,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:01.417606 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.426597 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/f46bbb8e-cca6-4a65-abec-4e0b511f3e65 HTTP/1.1" status: 204  len: 168 time: 0.4196775
Jun 01 12:35:01.427601 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:01.457921 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Usage tracker for resource:security_group_rule and tenant:f68ac0be4fd24be3833b443de4446a95 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:01.472653 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:01.480782 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Pushing event updated for resources: {'Port': ['ID=173aae46-c6ad-4fa4-b7a3-a900710d3701,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:01.494750 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:01.497303 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:01.499088 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.211s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:01.528791 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=df29c652-347e-49a6-a0e3-2dc795c817fc,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:01.544289 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Attempting to bind port 173aae46-c6ad-4fa4-b7a3-a900710d3701 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:35:01.544944 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Attempting to bind port 173aae46-c6ad-4fa4-b7a3-a900710d3701 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:35:01.545926 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Attempting to bind port 173aae46-c6ad-4fa4-b7a3-a900710d3701 on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:35:01.555227 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:01.559594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Port 173aae46-c6ad-4fa4-b7a3-a900710d3701 on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:35:01.561083 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Attempting to bind port 173aae46-c6ad-4fa4-b7a3-a900710d3701 on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:35:01.569712 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55718) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:01.611305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 34, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:35:01.611635 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Checking segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:35:01.612013 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Bound using segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:35:01.612455 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Bound port: 173aae46-c6ad-4fa4-b7a3-a900710d3701, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:35:01.612822 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.749656 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] For port 173aae46-c6ad-4fa4-b7a3-a900710d3701, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:35:01.755821 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] For port 173aae46-c6ad-4fa4-b7a3-a900710d3701, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:35:01.780870 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.797919 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8ca4b7da-64c9-47f9-9bfa-309e60a2bd6a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:01.849197 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.871119 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.874016 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:01.876590 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:01.877199 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.878582 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] 10.222.0.95 "PUT /v2.0/ports/173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 1093 time: 2.2394886
Jun 01 12:35:01.879045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:35:01.880011 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Usage tracker for resource:security_group_rule and tenant:e1be77e508e34b4cb183be485bd0d680 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:01.881315 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453" -d '{"events": [{"name": "network-changed", "server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:35:01.884757 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:01.892774 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:01.896205 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:01.927619 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Pushing event updated for resources: {'Port': ['ID=173aae46-c6ad-4fa4-b7a3-a900710d3701,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:01.932325 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca338b89-875b-43f7-bb9d-0f9ab0b6070d req-cd01ef36-9c92-435c-b0a5-5d07313010b4 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:01.942193 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:01.942858 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-937166b2-608b-4e9b-94e0-a8777ad6188f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.033s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:01.944266 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca338b89-875b-43f7-bb9d-0f9ab0b6070d req-cd01ef36-9c92-435c-b0a5-5d07313010b4 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 943 time: 0.1838129
Jun 01 12:35:02.003090 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:35:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f2dc978-1607-4405-9ec1-693ff004d61d x-openstack-request-id: req-0f2dc978-1607-4405-9ec1-693ff004d61d {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:35:02.003397 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:35:02.003715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-0f2dc978-1607-4405-9ec1-693ff004d61d {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:35:02.004066 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'status': 'completed', 'code': 200}
Jun 01 12:35:02.019110 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-904961df-4017-426a-917e-d8414c816ead admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f68ac0be4fd24be3833b443de4446a95&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7974794
Jun 01 12:35:02.027564 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55734) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:02.054089 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca338b89-875b-43f7-bb9d-0f9ab0b6070d req-6aacd3b2-5924-441e-bf7e-7f928b7ea7f0 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1087432
Jun 01 12:35:02.082070 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55738) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:02.091884 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46d948de-4c08-4198-9d0f-f79011580751,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:02.114092 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:02.131344 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.169687 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.171061 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:02.175723 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Usage tracker for resource:security_group_rule and tenant:5c69b29cffe643149b4c77d6309924a2 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:02.178854 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.187483 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:02.190772 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6316a9a8-8ca3-4268-a274-ffda59c04a21 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:02.207661 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:02.208194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-e450c8ba-d2f4-4fb6-85c8-a5bff52ef2ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:02.209819 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-e450c8ba-d2f4-4fb6-85c8-a5bff52ef2ce service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1096 time: 0.2585454
Jun 01 12:35:02.219869 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.254174 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e1be77e508e34b4cb183be485bd0d680&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6828570
Jun 01 12:35:02.257956 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.264768 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55744) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:02.269337 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24d933b0-1506-4353-aa33-6e7ae3e080bf,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:02.272470 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:02.278161 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf7d0de0-e0b9-4485-b833-612f31d6436c req-63ed9f41-e879-47c6-9bd2-380139a308dd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:02.280495 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bf7d0de0-e0b9-4485-b833-612f31d6436c req-63ed9f41-e879-47c6-9bd2-380139a308dd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 943 time: 0.1620455
Jun 01 12:35:02.386985 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bf7d0de0-e0b9-4485-b833-612f31d6436c req-1ca9a9a3-a46a-424c-8702-50ac8df84776 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0825601
Jun 01 12:35:02.405946 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.406302 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.416251 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.420365 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.426083 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5badb92d-a15a-4017-a195-83f6d748b09a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:02.426880 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b557ed6d-6543-45ad-9687-e6f70a024686 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:02.448330 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46d948de-4c08-4198-9d0f-f79011580751,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:02.453911 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:02.455718 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.475839 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be3429b-54c3-426f-abe2-88b8cee32811 req-4f921e73-7006-4422-8676-1829e18804bd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:02.478175 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2be3429b-54c3-426f-abe2-88b8cee32811 req-4f921e73-7006-4422-8676-1829e18804bd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.1707346
Jun 01 12:35:02.484772 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.488270 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/46d948de-4c08-4198-9d0f-f79011580751 HTTP/1.1" status: 204  len: 168 time: 0.4480317
Jun 01 12:35:02.492365 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5c69b29cffe643149b4c77d6309924a2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4086661
Jun 01 12:35:02.494929 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55750) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:02.511796 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a4b2ca2-5bae-4ffb-bfa5-c1d0d34e9815,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:02.514874 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:02.553187 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2be3429b-54c3-426f-abe2-88b8cee32811 req-48ad2203-8ee6-4d0b-a995-f976ed97b614 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0650012
Jun 01 12:35:02.566701 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.574115 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9a8e2320-d22f-4f33-9b7d-07bf7e0313c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:02.585671 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.587557 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24d933b0-1506-4353-aa33-6e7ae3e080bf,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:02.591072 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:02.611643 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.612734 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/24d933b0-1506-4353-aa33-6e7ae3e080bf HTTP/1.1" status: 204  len: 168 time: 0.3464038
Jun 01 12:35:02.620635 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.682200 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.686159 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:02.700992 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a4b2ca2-5bae-4ffb-bfa5-c1d0d34e9815,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:02.704263 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:02.706307 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:02.707500 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/9a4b2ca2-5bae-4ffb-bfa5-c1d0d34e9815 HTTP/1.1" status: 204  len: 168 time: 0.2116036
Jun 01 12:35:02.930455 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d61046d2-ead3-4c6a-a151-93c1f0fc8249 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:35:03.106708 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d61046d2-ead3-4c6a-a151-93c1f0fc8249, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:03.126717 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249', 'network_id': '5cafd137-be6a-4c7c-b850-6777e5242610', 'port_id': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249', 'mac_address': 'fa:16:3e:c3:be:22', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 790, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6295b8a8-665d-493b-bc88-f7898265e5fa', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:35:03.256460 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.269345 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55788) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:03.298070 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.304686 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d61046d2-ead3-4c6a-a151-93c1f0fc8249 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:35:03.339987 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d61046d2-ead3-4c6a-a151-93c1f0fc8249, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:03.343631 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:03.348360 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.350282 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e5fcfe8b-4fea-46e9-af0f-994864118677 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:03.355623 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Usage tracker for resource:security_group_rule and tenant:bc675c38407b485cba89816fb31e173f is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:03.363754 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b931ac9-afc8-4c5b-a14e-6748c38b99ba req-faf8d928-2570-428e-8791-5251659115af tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:03.364492 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-2b931ac9-afc8-4c5b-a14e-6748c38b99ba req-faf8d928-2570-428e-8791-5251659115af tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:35:03.369187 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:03.376043 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:03.400306 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-2b931ac9-afc8-4c5b-a14e-6748c38b99ba req-faf8d928-2570-428e-8791-5251659115af tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:35:03.412955 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b931ac9-afc8-4c5b-a14e-6748c38b99ba req-faf8d928-2570-428e-8791-5251659115af tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 943 time: 0.1729417
Jun 01 12:35:03.501928 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=d61046d2-ead3-4c6a-a151-93c1f0fc8249,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:03.506515 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b931ac9-afc8-4c5b-a14e-6748c38b99ba req-2743f5f0-334c-4ac0-abf2-b94369438c42 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0893269
Jun 01 12:35:03.509776 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:03.511881 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.525424 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.536459 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1c54d581-70ee-4faa-8059-4e8c2d648434 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:03.580258 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=bc675c38407b485cba89816fb31e173f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3098414
Jun 01 12:35:03.582217 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8eb70f33-09ab-4a4b-9a96-ca12eaa754d0,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:03.583003 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55808) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:03.585696 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:03.716248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d0d5480-9e86-4b25-81c2-525fd8fdc030 req-50c6869b-5343-447b-9851-1520e46aa8a2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:03.719227 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2d0d5480-9e86-4b25-81c2-525fd8fdc030 req-50c6869b-5343-447b-9851-1520e46aa8a2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 944 time: 0.1240046
Jun 01 12:35:03.737600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.776699 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.807042 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2d0d5480-9e86-4b25-81c2-525fd8fdc030 req-ec744461-1b4a-4ba1-9847-15355c1c7b69 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0807748
Jun 01 12:35:03.853140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76bfc782-b782-48ae-bcc1-91bcb9869e9f req-ab8a8918-2a12-4334-b04f-6fd7ea3f88d9 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:03.857055 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-76bfc782-b782-48ae-bcc1-91bcb9869e9f req-ab8a8918-2a12-4334-b04f-6fd7ea3f88d9 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.1717777
Jun 01 12:35:03.964126 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.971115 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-eb1a6bbf-936f-4d4a-a622-4d5df196cd29 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:03.981579 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-76bfc782-b782-48ae-bcc1-91bcb9869e9f req-8f2d5479-ce35-4f38-af1c-cbabf0f8157b tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1197734
Jun 01 12:35:03.983876 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8eb70f33-09ab-4a4b-9a96-ca12eaa754d0,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:03.986192 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:03.992252 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:03.994162 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/8eb70f33-09ab-4a4b-9a96-ca12eaa754d0 HTTP/1.1" status: 204  len: 168 time: 0.4094157
Jun 01 12:35:04.436282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 55848) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:04.662394 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:04.680435 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:04.685744 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Usage tracker for resource:security_group_rule and tenant:118e5d276a23470ab5ff298261147c73 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:04.689570 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:04.699445 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:04.707771 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93d17d0-ecdb-4c46-ae79-f0b29d9b3514 req-879861e8-3760-4a81-8160-41d15163d458 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:04.709988 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e93d17d0-ecdb-4c46-ae79-f0b29d9b3514 req-879861e8-3760-4a81-8160-41d15163d458 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 943 time: 0.0965519
Jun 01 12:35:04.772164 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e93d17d0-ecdb-4c46-ae79-f0b29d9b3514 req-2187d09b-8f26-48e6-a58e-724aa54d1f28 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0539763
Jun 01 12:35:04.814483 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:04.850541 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device c612c626-62cb-4f01-863c-58dbaf411409 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:35:04.963006 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port c612c626-62cb-4f01-863c-58dbaf411409 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:35:04.969596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port c612c626-62cb-4f01-863c-58dbaf411409 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:35:04.970137 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:04.973922 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-573bb8e2-3139-4c9f-98b7-25366bbfe064 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 217 time: 0.1434166
Jun 01 12:35:04.975231 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.021637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1a1a09bf-00f2-47f4-b8d3-3211286d94b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:05.108882 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d61046d2-ead3-4c6a-a151-93c1f0fc8249'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:35:05.127277 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55890) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:05.140915 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55898) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:05.141100 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=118e5d276a23470ab5ff298261147c73&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7028103
Jun 01 12:35:05.144900 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2acee39-fa80-4aa2-8c12-c58d70298296,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:05.156499 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:05.161338 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-3f4f643b-4f8e-48df-a173-4227413853d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:05.162777 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-3f4f643b-4f8e-48df-a173-4227413853d1 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.1427011
Jun 01 12:35:05.191626 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.234379 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port c612c626-62cb-4f01-863c-58dbaf411409, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=c612c626-62cb-4f01-863c-58dbaf411409,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:05.238291 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c612c626-62cb-4f01-863c-58dbaf411409'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:35:05.241365 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2efab070-ba4e-4ae3-a630-a632a7139f7c" -d '{"events": [{"server_uuid": "9667206d-ce8b-4b7f-bacb-a9e2fed82b66", "name": "network-vif-plugged", "status": "completed", "tag": "c612c626-62cb-4f01-863c-58dbaf411409"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:35:05.247799 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.250208 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-23281ab6-e3ee-4409-a58f-f545369277b7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:05.256113 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-355e43e4-a32a-41a8-90c3-fe5d80efae6c req-63efcf2e-cc60-4204-af8d-5d986d57a3d5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:05.263632 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-355e43e4-a32a-41a8-90c3-fe5d80efae6c req-63efcf2e-cc60-4204-af8d-5d986d57a3d5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 944 time: 0.2916226
Jun 01 12:35:05.308534 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1267955216-network', 'tenant_id': '9bfc9ce553aa4aad8cea2b35857daf79'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:05.314154 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:05.318164 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Usage tracker for resource:network and tenant:9bfc9ce553aa4aad8cea2b35857daf79 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:05.319359 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-a4a16db1-5f91-4773-a3b2-afcfb33d18bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:05.320903 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-a4a16db1-5f91-4773-a3b2-afcfb33d18bd service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1505773
Jun 01 12:35:05.321722 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:05.328287 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:05.335696 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-355e43e4-a32a-41a8-90c3-fe5d80efae6c req-1deef4cc-62dd-4381-8047-e8d923b93c0b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0704942
Jun 01 12:35:05.342071 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Made reservation on behalf of 9bfc9ce553aa4aad8cea2b35857daf79 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:05.344914 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.361111 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.383963 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=c612c626-62cb-4f01-863c-58dbaf411409,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:05.394048 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:05.425094 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:05.434418 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.439882 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:35:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27ee2400-7f97-46d5-9c70-208d55a0cf55 x-openstack-request-id: req-27ee2400-7f97-46d5-9c70-208d55a0cf55 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:35:05.440185 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9667206d-ce8b-4b7f-bacb-a9e2fed82b66", "name": "network-vif-plugged", "status": "completed", "tag": "c612c626-62cb-4f01-863c-58dbaf411409", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:35:05.440444 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-27ee2400-7f97-46d5-9c70-208d55a0cf55 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:35:05.440859 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c612c626-62cb-4f01-863c-58dbaf411409', 'code': 200}
Jun 01 12:35:05.494163 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Usage tracker for resource:security_group_rule and tenant:9bfc9ce553aa4aad8cea2b35857daf79 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:05.510331 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.540082 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-46b8e28a-fa85-461e-bf85-b0b23b2a3d5c service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1992877
Jun 01 12:35:05.543607 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:05.564996 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:05.580468 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e0d90c2-709f-4a9c-9130-290caad5a0c3 req-2d37e269-ee48-4a1d-ba1f-ecd1083f510e tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:05.590546 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2e0d90c2-709f-4a9c-9130-290caad5a0c3 req-2d37e269-ee48-4a1d-ba1f-ecd1083f510e tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.4138291
Jun 01 12:35:05.765879 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2e0d90c2-709f-4a9c-9130-290caad5a0c3 req-8c46f656-a239-4883-b697-bdc2ac4f63b8 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1737628
Jun 01 12:35:05.775877 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.784450 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9115ab54-7614-4568-9965-e10059b1ef13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:05.791291 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6bb0a2d0-dacd-4991-9f8d-946eae7e8cfa req-54fa4fe5-e81a-4ec9-a388-bfda35196ce9 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2396941
Jun 01 12:35:05.808139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2acee39-fa80-4aa2-8c12-c58d70298296,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:05.815404 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:05.818246 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e03dc4-22a7-4b5b-8e41-5543e811949a req-b80272a6-9f79-408d-aafa-9c3f8ab14d52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:05.819762 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-05e03dc4-22a7-4b5b-8e41-5543e811949a req-b80272a6-9f79-408d-aafa-9c3f8ab14d52 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.1724989
Jun 01 12:35:05.863136 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.864260 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b2acee39-fa80-4aa2-8c12-c58d70298296 HTTP/1.1" status: 204  len: 168 time: 0.7222795
Jun 01 12:35:05.874471 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.885628 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:35:05.886316 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:05.897857 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8f01df06-c60c-45c3-87d3-e5df4fe398a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:05.966922 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-05e03dc4-22a7-4b5b-8e41-5543e811949a req-e3f68ed2-14aa-45df-aee5-0b183a26f271 service neutron] Synchronizing usage tracker for tenant:e514b1b3a3c44b1fba238df8cf212874 on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:35:05.975441 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] vlan segment allocate from pool success with {'vlan_id': 769, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:35:05.982163 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5347de1b-b95d-4756-812e-5528e3f2330d,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:06.000078 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:06.010637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-05e03dc4-22a7-4b5b-8e41-5543e811949a req-e3f68ed2-14aa-45df-aee5-0b183a26f271 service neutron] Unset dirty status for tenant:e514b1b3a3c44b1fba238df8cf212874 on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:35:06.010772 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:06.011118 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Added segment c82095c1-0e47-40a0-98c4-b0d498e59e78 of type vlan for network f19259de-17ac-4f4f-904d-a0093269aa55
Jun 01 12:35:06.012455 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-05e03dc4-22a7-4b5b-8e41-5543e811949a req-e3f68ed2-14aa-45df-aee5-0b183a26f271 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1782589
Jun 01 12:35:06.018988 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-bb06270a-b720-4829-a214-3595357d00d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:06.021138 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-bb06270a-b720-4829-a214-3595357d00d1 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1096 time: 0.1459594
Jun 01 12:35:06.073894 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:06.124218 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:06.134511 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:06.147393 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:06.182357 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:06.229809 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c621568d-5658-4198-a8f4-6e1ccf9ba7cf req-22bb3ccd-6fe0-4f03-9293-3c171aa0b3ba tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:06.236971 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c621568d-5658-4198-a8f4-6e1ccf9ba7cf req-22bb3ccd-6fe0-4f03-9293-3c171aa0b3ba tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 943 time: 0.2011240
Jun 01 12:35:06.308093 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-101a139c-9e6f-4b51-b576-5796c0743fb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:06.309597 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-101a139c-9e6f-4b51-b576-5796c0743fb0 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.2283492
Jun 01 12:35:06.328597 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 1.1936681
Jun 01 12:35:06.328597 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 55930) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:06.334687 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Request body: {'subnet': {'network_id': 'f19259de-17ac-4f4f-904d-a0093269aa55', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1267955216-subnet', 'tenant_id': '9bfc9ce553aa4aad8cea2b35857daf79', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:06.342640 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:06.349338 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Pushing event updated for resources: {'Network': ['ID=f19259de-17ac-4f4f-904d-a0093269aa55,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:06.374390 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network f19259de-17ac-4f4f-904d-a0093269aa55 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:35:06.386039 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Usage tracker for resource:subnet and tenant:9bfc9ce553aa4aad8cea2b35857daf79 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:06.391635 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:06.396761 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:06.410667 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:06.426561 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-d5836b76-bb77-4196-91cd-c599a3d88681 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 217 time: 0.0968289
Jun 01 12:35:06.433466 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Made reservation on behalf of 9bfc9ce553aa4aad8cea2b35857daf79 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:06.437313 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:06.438473 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c621568d-5658-4198-a8f4-6e1ccf9ba7cf req-7c163c1c-f6af-437c-a1f3-32b4869cde32 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2004766
Jun 01 12:35:06.524625 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-5b414f78-aeea-47cd-97c2-b8332b09dc83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:06.527005 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-5b414f78-aeea-47cd-97c2-b8332b09dc83 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0866499
Jun 01 12:35:06.650177 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-9ecb14fa-30da-47de-bbb4-ae7031c0d280 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:06.651716 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-9ecb14fa-30da-47de-bbb4-ae7031c0d280 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1099873
Jun 01 12:35:06.829615 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317f53b7-f42b-47c3-831c-8741fd8bace4 req-2ded66cd-db3f-4e10-81d9-2cae9bdfb58f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:06.830991 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-317f53b7-f42b-47c3-831c-8741fd8bace4 req-2ded66cd-db3f-4e10-81d9-2cae9bdfb58f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 944 time: 0.2333400
Jun 01 12:35:06.912746 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-317f53b7-f42b-47c3-831c-8741fd8bace4 req-a28b372f-66b1-4c17-b9be-f7484d248b57 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0684483
Jun 01 12:35:07.004440 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a671b1-c4a1-478d-997d-02345589913c req-b358ab69-0b37-4eab-a7f3-40360c84c387 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:07.013855 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-00a671b1-c4a1-478d-997d-02345589913c req-b358ab69-0b37-4eab-a7f3-40360c84c387 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.1219466
Jun 01 12:35:07.060661 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-00a671b1-c4a1-478d-997d-02345589913c req-be78e675-dd62-46a1-a5c8-ad78bb83e00a tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0437040
Jun 01 12:35:07.143061 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:07.147461 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-35adb60d-43b5-4be6-9793-f56476dea266 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:07.221454 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a5ece44-875e-439b-8b09-f33e94bd16f6,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:07.224219 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:07.231732 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Checking segment: {'id': 'c82095c1-0e47-40a0-98c4-b0d498e59e78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 769, 'network_id': 'f19259de-17ac-4f4f-904d-a0093269aa55'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:35:07.232153 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Network hostable DHCP agents. Network: f19259de-17ac-4f4f-904d-a0093269aa55, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:35:07.250761 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Network f19259de-17ac-4f4f-904d-a0093269aa55 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:35:07.260839 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, f19259de-17ac-4f4f-904d-a0093269aa55) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:35:07.265211 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:07.265972 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:07.272542 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb6dd2b0-d384-4722-b685-074758635a71 None None] Network f19259de-17ac-4f4f-904d-a0093269aa55 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:07.298154 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.9619997
Jun 01 12:35:07.554358 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d28f7768-db6a-418d-9cc3-c60dee333f45 None None] Network f19259de-17ac-4f4f-904d-a0093269aa55 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:07.733307 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ea5a8a-7018-45f4-9e45-b9536a5d92b7 req-1045c8ff-1d07-4f07-938f-9cb4db63980c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:07.742702 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c8ea5a8a-7018-45f4-9e45-b9536a5d92b7 req-1045c8ff-1d07-4f07-938f-9cb4db63980c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 943 time: 0.1218915
Jun 01 12:35:07.815812 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c8ea5a8a-7018-45f4-9e45-b9536a5d92b7 req-f05a9e76-a9de-4b5a-896f-b280e43182dc tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0718594
Jun 01 12:35:07.897793 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d61046d2-ead3-4c6a-a151-93c1f0fc8249 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:35:07.999431 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-77d994c9-2bc6-4aa1-a41d-6a39fbedab58 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2465813
Jun 01 12:35:08.011722 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port d61046d2-ead3-4c6a-a151-93c1f0fc8249 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:35:08.020249 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port d61046d2-ead3-4c6a-a151-93c1f0fc8249 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:35:08.020657 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.027469 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56024) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:08.233132 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.238005 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56036) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:08.243575 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-200bf6af-ad6a-4535-a871-b6aea44fe644 req-717a16e0-5d79-4481-a366-3d8f5d8262cc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:08.245072 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-200bf6af-ad6a-4535-a871-b6aea44fe644 req-717a16e0-5d79-4481-a366-3d8f5d8262cc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 944 time: 0.1953249
Jun 01 12:35:08.249956 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-321290069-network', 'tenant_id': '151465a92b184a54ab5244ea4f7838b4'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:08.255204 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:08.259625 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Usage tracker for resource:network and tenant:151465a92b184a54ab5244ea4f7838b4 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:08.264791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:08.267788 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b63720-9350-4913-8f50-5662b9575005', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:35:08.271165 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2dd96c3a-467f-4b2d-87e6-9fced0b10937" -d '{"events": [{"server_uuid": "43b63720-9350-4913-8f50-5662b9575005", "name": "network-vif-plugged", "status": "completed", "tag": "d61046d2-ead3-4c6a-a151-93c1f0fc8249"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:35:08.273643 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:08.282562 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d61046d2-ead3-4c6a-a151-93c1f0fc8249, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:08.288459 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.290549 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:08.304176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.306820 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-200bf6af-ad6a-4535-a871-b6aea44fe644 req-af459a26-c34a-47ca-8dcf-026e10fdb00c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0527136
Jun 01 12:35:08.323374 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Made reservation on behalf of 151465a92b184a54ab5244ea4f7838b4 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:08.325862 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.333557 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:35:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c362cb65-36e5-49cc-9606-5d1445e8602d x-openstack-request-id: req-c362cb65-36e5-49cc-9606-5d1445e8602d {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:35:08.333864 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b63720-9350-4913-8f50-5662b9575005", "name": "network-vif-plugged", "status": "completed", "tag": "d61046d2-ead3-4c6a-a151-93c1f0fc8249", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:35:08.334121 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-c362cb65-36e5-49cc-9606-5d1445e8602d {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:35:08.334480 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b63720-9350-4913-8f50-5662b9575005', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249', 'code': 200}
Jun 01 12:35:08.339802 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:08.341972 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.354846 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Usage tracker for resource:security_group_rule and tenant:a1075dd28ba74e41a004c535364d4fe3 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:08.359779 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:08.362598 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:08.366122 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=d61046d2-ead3-4c6a-a151-93c1f0fc8249,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:08.368203 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:08.369145 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:08.370321 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Usage tracker for resource:security_group_rule and tenant:151465a92b184a54ab5244ea4f7838b4 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:08.374377 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:08.383232 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:08.511817 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.518743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.527361 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:08.538938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.547161 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.578886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b97b3f22-e2a9-4c03-ad8a-3e3e2104b5dd,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:08.585344 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=a1075dd28ba74e41a004c535364d4fe3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5557170
Jun 01 12:35:08.586235 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:08.586892 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] vlan segment allocate from pool success with {'vlan_id': 777, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:35:08.588159 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56044) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:08.588784 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.026s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:08.614552 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.614885 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Added segment bd382fab-27c0-4c70-bd61-e318bee7363d of type vlan for network 1f07c5f0-c38d-4387-a9df-bf257dfdcbbe
Jun 01 12:35:08.623413 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5bac8cd3-5c0c-4fe6-93c3-26dc2bc6d27f,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:08.626854 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:08.649337 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.651518 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.677810 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.682753 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.684734 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:08.685376 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.691653 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e01391b0-625a-4d2b-b54d-92aee40d83bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:08.748625 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.752760 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d1049067-80ad-4383-86b7-813dc177f8a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:08.767256 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b97b3f22-e2a9-4c03-ad8a-3e3e2104b5dd,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:08.769743 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:08.780450 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:08.782549 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b97b3f22-e2a9-4c03-ad8a-3e3e2104b5dd HTTP/1.1" status: 204  len: 168 time: 0.1933999
Jun 01 12:35:08.800043 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Pushing event updated for resources: {'Network': ['ID=1f07c5f0-c38d-4387-a9df-bf257dfdcbbe,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:08.802958 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:08.805611 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.5660808
Jun 01 12:35:08.808573 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56054) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:08.814119 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 1f07c5f0-c38d-4387-a9df-bf257dfdcbbe details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:35:08.814624 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Request body: {'subnet': {'network_id': '1f07c5f0-c38d-4387-a9df-bf257dfdcbbe', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-321290069-subnet', 'tenant_id': '151465a92b184a54ab5244ea4f7838b4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:08.819288 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:08.823576 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Usage tracker for resource:subnet and tenant:151465a92b184a54ab5244ea4f7838b4 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:08.826616 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:08.833630 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:08.864052 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Made reservation on behalf of 151465a92b184a54ab5244ea4f7838b4 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:08.869047 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:09.023074 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4906f4b2-8296-4a9b-9437-6fddba6969a9 req-06b3a1c5-745e-4b5a-80f5-79abc08d54cc tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:09.025151 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4906f4b2-8296-4a9b-9437-6fddba6969a9 req-06b3a1c5-745e-4b5a-80f5-79abc08d54cc tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 943 time: 0.0914280
Jun 01 12:35:09.076572 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4906f4b2-8296-4a9b-9437-6fddba6969a9 req-16650628-3910-4258-83d9-26863dc91c13 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393124
Jun 01 12:35:09.296612 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:09.301612 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b27d9c7f-f1d4-4283-b090-6a965f8d60e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:09.375027 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=04b8601d-8e49-48f4-b84c-89f757a89dd3,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:09.378502 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:09.382797 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Checking segment: {'id': 'bd382fab-27c0-4c70-bd61-e318bee7363d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 777, 'network_id': '1f07c5f0-c38d-4387-a9df-bf257dfdcbbe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:35:09.383248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Network hostable DHCP agents. Network: 1f07c5f0-c38d-4387-a9df-bf257dfdcbbe, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:35:09.404842 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Network 1f07c5f0-c38d-4387-a9df-bf257dfdcbbe is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:35:09.456556 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 1f07c5f0-c38d-4387-a9df-bf257dfdcbbe) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:35:09.465686 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-467684cd-7d76-4981-848d-ee20f1badd70 None None] Network 1f07c5f0-c38d-4387-a9df-bf257dfdcbbe requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:09.470273 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:09.473026 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:09.512128 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.7023470
Jun 01 12:35:09.538191 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ec8023-b460-47f5-a8da-82ac6588db4c req-65d9afe1-5b77-48f0-8fa0-5c61f5bb6285 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:09.540125 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-54ec8023-b460-47f5-a8da-82ac6588db4c req-65d9afe1-5b77-48f0-8fa0-5c61f5bb6285 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1236544
Jun 01 12:35:09.593592 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-54ec8023-b460-47f5-a8da-82ac6588db4c req-25aedfdb-4562-4f5b-89c7-38bc62d3f9f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456719
Jun 01 12:35:09.687511 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01187be8-80cc-4098-984d-693d55f10239 None None] Network 1f07c5f0-c38d-4387-a9df-bf257dfdcbbe requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:09.711305 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 173aae46-c6ad-4fa4-b7a3-a900710d3701 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:35:09.989100 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ea4bd011-772b-4511-b20d-4ada0f7d0193 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:10.011015 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 173aae46-c6ad-4fa4-b7a3-a900710d3701, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:10.013668 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a8bbb51-e8f3-4016-abb7-e126e2b3a453 req-6d78361a-24a2-41fe-9eeb-5b2c6bc1a985 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3223429
Jun 01 12:35:10.104355 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'port_id': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'mac_address': 'fa:16:3e:16:4f:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 765, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:35:10.184645 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:10.207072 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 173aae46-c6ad-4fa4-b7a3-a900710d3701 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:35:10.235497 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 173aae46-c6ad-4fa4-b7a3-a900710d3701, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:10.243183 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:10.245977 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:10.341520 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5da5ca5-53be-4712-911c-80b511816c5f req-b125282c-d31b-4dd9-91e5-9e7fa4bc4e58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:10.342977 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e5da5ca5-53be-4712-911c-80b511816c5f req-b125282c-d31b-4dd9-91e5-9e7fa4bc4e58 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 1098 time: 0.2000792
Jun 01 12:35:10.351684 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=173aae46-c6ad-4fa4-b7a3-a900710d3701,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:10.356931 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:10.405792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccba3170-9f48-4297-b550-51aee6052af8 req-c3062650-c25e-4327-944a-f8cadea89b8f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:10.407262 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ccba3170-9f48-4297-b550-51aee6052af8 req-c3062650-c25e-4327-944a-f8cadea89b8f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 944 time: 0.1634798
Jun 01 12:35:10.413407 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e5da5ca5-53be-4712-911c-80b511816c5f req-8d480a13-2dca-48bc-92fd-31d2afc1a5c3 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0638115
Jun 01 12:35:10.461343 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ccba3170-9f48-4297-b550-51aee6052af8 req-3e4cf07c-c57e-4a35-a51c-76ad70983df0 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459921
Jun 01 12:35:10.535684 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['173aae46-c6ad-4fa4-b7a3-a900710d3701'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:35:10.867122 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ca061c-07fa-4ed7-9a86-f8f8477d746a req-382c197f-3afe-42f6-bb14-2a72c4e32de6 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:10.868956 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-79ca061c-07fa-4ed7-9a86-f8f8477d746a req-382c197f-3afe-42f6-bb14-2a72c4e32de6 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1226976
Jun 01 12:35:10.923109 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-79ca061c-07fa-4ed7-9a86-f8f8477d746a req-e417ec6f-428d-478b-aca1-8e861d5ab32e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0482106
Jun 01 12:35:11.706055 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bd68fc-e95d-4be9-9a4d-b5e6ee632f56 req-def8042e-cf48-43e8-b13e-b2dd62eddb50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:11.708585 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-44bd68fc-e95d-4be9-9a4d-b5e6ee632f56 req-def8042e-cf48-43e8-b13e-b2dd62eddb50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 944 time: 0.1062210
Jun 01 12:35:11.711194 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 173aae46-c6ad-4fa4-b7a3-a900710d3701 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:35:11.778376 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-44bd68fc-e95d-4be9-9a4d-b5e6ee632f56 req-5ddf453f-669f-41b5-a4f7-9c2a53b2440d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0579696
Jun 01 12:35:11.820781 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 173aae46-c6ad-4fa4-b7a3-a900710d3701 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:35:11.826491 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 173aae46-c6ad-4fa4-b7a3-a900710d3701 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:35:11.826876 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:11.966134 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:12.011450 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:35:12.011877 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e47ecd52-5afc-4cad-9c6b-9b919da367c0" -d '{"events": [{"server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "name": "network-vif-plugged", "status": "completed", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:35:12.021223 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 173aae46-c6ad-4fa4-b7a3-a900710d3701, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:12.026954 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:12.035303 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:12.088198 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:35:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90702a86-b23e-48e3-bd94-1a94e347fc0a x-openstack-request-id: req-90702a86-b23e-48e3-bd94-1a94e347fc0a {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:35:12.088625 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "name": "network-vif-plugged", "status": "completed", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:35:12.088956 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-90702a86-b23e-48e3-bd94-1a94e347fc0a {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:35:12.089437 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'code': 200}
Jun 01 12:35:12.195278 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:12.219908 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=173aae46-c6ad-4fa4-b7a3-a900710d3701,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:12.227510 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:12.234899 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f99e93-9137-47d3-803b-10b1b4ffeb83 req-9126d520-95bb-49cb-9855-586093ba0b0c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:12.243634 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-30f99e93-9137-47d3-803b-10b1b4ffeb83 req-9126d520-95bb-49cb-9855-586093ba0b0c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1498473
Jun 01 12:35:12.329634 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:12.402218 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-30f99e93-9137-47d3-803b-10b1b4ffeb83 req-83e79240-f854-4808-9de0-5c779995f831 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1575782
Jun 01 12:35:12.544614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91dc56f7-90eb-47ab-8c50-476ff362e494 req-58e0d571-ecea-427e-a030-2ba4a83d48be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:12.550317 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-91dc56f7-90eb-47ab-8c50-476ff362e494 req-58e0d571-ecea-427e-a030-2ba4a83d48be service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1098 time: 0.1603241
Jun 01 12:35:12.579206 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56250) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:12.617395 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-91dc56f7-90eb-47ab-8c50-476ff362e494 req-58415db4-8c5c-48aa-9a9f-a2f0ae75aeed service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0541458
Jun 01 12:35:12.671519 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-740e966b-8ba5-4c8e-b270-aa898bfcaf37 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:12.837086 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:12.902984 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:12.912037 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Usage tracker for resource:security_group_rule and tenant:d142c45b952f48dd955c69b985405e03 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:12.919846 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:12.934797 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:12.967415 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa72b158-7638-4a04-a841-fd114a908507 req-59ade8bd-2d35-4fc3-bace-7ee1fdc070d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:12.969454 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa72b158-7638-4a04-a841-fd114a908507 req-59ade8bd-2d35-4fc3-bace-7ee1fdc070d9 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 1098 time: 0.1606982
Jun 01 12:35:12.998525 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-425d1df0-6815-4a9c-bbef-8d81afcf91b7 req-c84a72ce-7d81-44b3-baa4-de22f691e961 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:12.998525 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-425d1df0-6815-4a9c-bbef-8d81afcf91b7 req-c84a72ce-7d81-44b3-baa4-de22f691e961 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1357431
Jun 01 12:35:13.048310 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-425d1df0-6815-4a9c-bbef-8d81afcf91b7 req-7c7c763d-bb3c-4bc9-ac26-df9b1751b350 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0496440
Jun 01 12:35:13.104710 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:13.109256 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:13.122443 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:13.132431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a60a8a6-38d1-453c-99de-ae83a074f12d req-fac17e12-e051-47eb-996e-8cef89b4488d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:13.134018 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5a60a8a6-38d1-453c-99de-ae83a074f12d req-fac17e12-e051-47eb-996e-8cef89b4488d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.2235699
Jun 01 12:35:13.181654 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa72b158-7638-4a04-a841-fd114a908507 req-d4ea931f-11ff-4a0e-b088-2ba1867d1434 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:13.183319 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa72b158-7638-4a04-a841-fd114a908507 req-d4ea931f-11ff-4a0e-b088-2ba1867d1434 service neutron] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 920 time: 0.2044146
Jun 01 12:35:13.187597 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d142c45b952f48dd955c69b985405e03&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6046615
Jun 01 12:35:13.187597 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=783765bd-6e0b-45d0-947c-03939fb2c0c1,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:13.188419 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56276) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:13.191132 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:13.252977 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:13.266342 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa72b158-7638-4a04-a841-fd114a908507 req-54d8cc3b-b030-4fcf-91af-095c2b002e38 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249 HTTP/1.1" status: 200  len: 217 time: 0.0717294
Jun 01 12:35:13.269118 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5a60a8a6-38d1-453c-99de-ae83a074f12d req-05f40a15-373f-493f-9a27-7e2cbe7cda6a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1144137
Jun 01 12:35:13.285994 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:13.344725 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa72b158-7638-4a04-a841-fd114a908507 req-45331c33-5d01-4fbd-a315-7aa8cc4e756a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:13.346234 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa72b158-7638-4a04-a841-fd114a908507 req-45331c33-5d01-4fbd-a315-7aa8cc4e756a service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.0651479
Jun 01 12:35:13.354472 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:13.359602 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:13.370684 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=783765bd-6e0b-45d0-947c-03939fb2c0c1,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:13.374278 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:13.378760 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:13.381706 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/783765bd-6e0b-45d0-947c-03939fb2c0c1 HTTP/1.1" status: 204  len: 168 time: 0.1920843
Jun 01 12:35:13.409787 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa72b158-7638-4a04-a841-fd114a908507 req-bd83bb40-d872-44f8-ba56-5c51c09b5cc1 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0567515
Jun 01 12:35:13.579110 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa72b158-7638-4a04-a841-fd114a908507 req-93064ded-4f6d-4f0f-be33-767cfd08226d service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1528804
Jun 01 12:35:13.740723 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa72b158-7638-4a04-a841-fd114a908507 req-d2b93df4-6f63-4349-aea7-08ce9046e827 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1483250
Jun 01 12:35:13.836201 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:14.279080 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-343c1ccb-6bca-413e-a985-6632be736807 req-80dc1ced-af0d-426a-ba13-70e78326d524 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:14.281498 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-343c1ccb-6bca-413e-a985-6632be736807 req-80dc1ced-af0d-426a-ba13-70e78326d524 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1083593
Jun 01 12:35:14.371971 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-343c1ccb-6bca-413e-a985-6632be736807 req-ba357bdd-771f-4cbf-8ce6-67e9e1452e6e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0846994
Jun 01 12:35:14.601387 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4a0d3c-010e-4da7-b9af-5292a82bde89 req-b39049a4-bb40-4114-8c3e-94a77956566b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:14.603114 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df4a0d3c-010e-4da7-b9af-5292a82bde89 req-b39049a4-bb40-4114-8c3e-94a77956566b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1020718
Jun 01 12:35:14.652981 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df4a0d3c-010e-4da7-b9af-5292a82bde89 req-b6da6d22-c37b-46ab-b96b-ea30692dd773 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0439837
Jun 01 12:35:14.708815 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56350) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:14.888378 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79b8729a-e65d-438b-9cd1-c9a0f34b6431 req-60d946e3-4a43-4552-8e79-1618ce1a6759 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:14.893534 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-79b8729a-e65d-438b-9cd1-c9a0f34b6431 req-60d946e3-4a43-4552-8e79-1618ce1a6759 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1185627
Jun 01 12:35:14.899332 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56362) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:14.907953 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'floatingip': {'port_id': '173aae46-c6ad-4fa4-b7a3-a900710d3701'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:14.929690 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:14.950290 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:14.957805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Usage tracker for resource:security_group_rule and tenant:47254b26a8b44ca89bf3d8e73f2e60f7 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:14.962027 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:14.974534 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:15.087416 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.109631 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.114795 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.144264 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ca49ce4b-7480-4ae2-af41-92c1b378346b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:15.154322 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=47254b26a8b44ca89bf3d8e73f2e60f7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4442723
Jun 01 12:35:15.157715 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56378) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:15.205775 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de593758-6f97-499b-9eeb-4fcbcb94ed0e,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:15.230776 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.231843 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.232257 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.235412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:15.242518 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:15.279507 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.322157 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.380205 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.418855 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.424804 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-54d6cd9a-49fc-4eac-b9cc-fa6b68b057ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:15.441330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de593758-6f97-499b-9eeb-4fcbcb94ed0e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:15.446171 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:15.447408 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:15.448604 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/de593758-6f97-499b-9eeb-4fcbcb94ed0e HTTP/1.1" status: 204  len: 168 time: 0.2896700
Jun 01 12:35:15.934419 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b31e351-09f3-49db-945c-5a5acf137174 req-5667f553-b832-439e-aa05-7aba61b170f1 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:15.941738 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9b31e351-09f3-49db-945c-5a5acf137174 req-5667f553-b832-439e-aa05-7aba61b170f1 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.3130801
Jun 01 12:35:16.051953 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9b31e351-09f3-49db-945c-5a5acf137174 req-9b47c249-713d-4f81-959c-7bca000d7c6b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1092894
Jun 01 12:35:16.109340 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56416) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:16.134953 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.165028 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:16.177074 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Usage tracker for resource:security_group_rule and tenant:45e06118bbdb4c0d99b50daf2e20d97b is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:16.181335 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:16.188684 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:16.221756 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.227998 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.385955 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.392745 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.400206 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56428) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:16.451244 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e951e3f2-094b-46b7-b432-8e51d82e7664 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:16.487794 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=45e06118bbdb4c0d99b50daf2e20d97b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3767498
Jun 01 12:35:16.491675 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56436) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:16.520563 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=829405e2-3b21-4523-b08b-bcac1b7d17f7,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:16.526879 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:16.551997 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Floating IP 595e28eb-9603-4a2e-91e7-06615e85864e associated. External IP: 172.27.3.247, port: 173aae46-c6ad-4fa4-b7a3-a900710d3701.
Jun 01 12:35:16.585715 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.613298 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.683987 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.692689 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7c0fa1c2-11be-4b88-982d-ef0c9665e030 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:16.711625 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=829405e2-3b21-4523-b08b-bcac1b7d17f7,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:16.714229 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:16.715514 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.719227 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/829405e2-3b21-4523-b08b-bcac1b7d17f7 HTTP/1.1" status: 204  len: 168 time: 0.2240353
Jun 01 12:35:16.731270 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:16.755313 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:16.810154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Usage tracker for resource:security_group_rule and tenant:cce45d893b9f47afab0d734f0c2c81b2 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:16.819914 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:16.839923 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:17.115300 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:17.129661 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:35:17.131386 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:17.139261 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:17.187202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f600584-86fc-4de4-a5fc-de5089681da1,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:17.258331 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.258573 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.258755 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.259073 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.259494 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.259886 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.260208 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.260625 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.261021 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.261381 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.261778 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.262124 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:35:17.265986 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:17.272819 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=cce45d893b9f47afab0d734f0c2c81b2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8669033
Jun 01 12:35:17.273074 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d30f9c75-8649-4c67-a2fa-871276e9f7e5 req-827e6212-8696-459f-aa1e-a4e297529a2e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:17.273336 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d30f9c75-8649-4c67-a2fa-871276e9f7e5 req-827e6212-8696-459f-aa1e-a4e297529a2e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0898087
Jun 01 12:35:17.273980 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56458) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:17.365871 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d30f9c75-8649-4c67-a2fa-871276e9f7e5 req-8243c79b-8f4d-4b18-b508-8e15f0f01fc8 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0761144
Jun 01 12:35:17.382219 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:17.408971 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:35:17.413479 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:17.426942 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] Sync routers for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:35:17.441146 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:17.445200 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:35:17.446002 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e839a0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:35:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:17.513299 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:17.520269 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-acfd47e7-2349-4f7e-b56b-5b224de134be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:17.545359 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7b2e3567-160d-41f5-ab24-631dbe54e7a3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "PUT /v2.0/floatingips/595e28eb-9603-4a2e-91e7-06615e85864e HTTP/1.1" status: 200  len: 991 time: 2.6447465
Jun 01 12:35:17.546053 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:35:17.548353 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c" -d '{"events": [{"name": "network-changed", "server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:35:17.551567 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f600584-86fc-4de4-a5fc-de5089681da1,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:17.555803 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:17.567162 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:17.568202 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/8f600584-86fc-4de4-a5fc-de5089681da1 HTTP/1.1" status: 204  len: 168 time: 0.2933297
Jun 01 12:35:17.636910 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:35:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50a90877-f714-4ff7-9a01-297cb2e7ec3a x-openstack-request-id: req-50a90877-f714-4ff7-9a01-297cb2e7ec3a {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:35:17.637220 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:35:17.637492 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-50a90877-f714-4ff7-9a01-297cb2e7ec3a {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:35:17.638006 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'status': 'completed', 'code': 200}
Jun 01 12:35:17.797747 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:35:17.869998 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-e16edda2-bd90-4bf3-a31d-15381c07a6e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:17.876394 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-e16edda2-bd90-4bf3-a31d-15381c07a6e7 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1098 time: 0.2045219
Jun 01 12:35:18.104649 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-fcee3db0-a58d-4ae3-beeb-372fffde68b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:18.106264 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-fcee3db0-a58d-4ae3-beeb-372fffde68b1 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.2065368
Jun 01 12:35:18.367316 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-6be1748c-32b1-4c10-8927-faa16d8ebbc4 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 999 time: 0.2464640
Jun 01 12:35:18.380228 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56506) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:18.410418 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:18.433893 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:18.438169 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Usage tracker for resource:security_group_rule and tenant:6f922816e3a74504a851ab8335e6942c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:18.441585 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:18.446846 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-2312e97a-829e-41ef-a9fc-61bf3eb21ae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:18.448623 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-2312e97a-829e-41ef-a9fc-61bf3eb21ae2 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0710537
Jun 01 12:35:18.449174 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:18.464896 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e839a0>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '595e28eb-9603-4a2e-91e7-06615e85864e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'floating_ip_address': '172.27.3.247', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'port_id': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 130, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'mac_address': 'fa:16:3e:16:4f:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:34:43Z', 'updated_at': '2021-06-01T12:35:15Z', 'revision_number': 1, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:18.473764 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] Checking router: 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:35:18.494968 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:35:18.497127 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e839a0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:35:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:18.579955 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-6ba3a4b3-8042-42c6-9b1b-88ffb5b55a91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:18.583540 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-6ba3a4b3-8042-42c6-9b1b-88ffb5b55a91 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1280491
Jun 01 12:35:18.625302 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:18.643788 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e04d37a-820d-4384-b134-d76ad85229b8 req-75666670-7e86-4741-9857-fcd3bee21216 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:18.646275 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4e04d37a-820d-4384-b134-d76ad85229b8 req-75666670-7e86-4741-9857-fcd3bee21216 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1403227
Jun 01 12:35:18.648119 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:18.657906 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d3347f06-d74c-4240-baed-b2f69323e584 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:18.748080 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:35:18.754152 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de50eaa4-a3bf-4759-a88d-8d7b9340af89,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:18.792267 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=6f922816e3a74504a851ab8335e6942c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4093721
Jun 01 12:35:18.794968 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56520) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:18.799026 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-f57633f7-4d91-407c-877d-abb9ba049c24 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2063065
Jun 01 12:35:18.809395 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4e04d37a-820d-4384-b134-d76ad85229b8 req-53e4882d-6045-4849-b8e8-e463b459fa74 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1536124
Jun 01 12:35:18.810981 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:18.983594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a780cc79-325d-4064-a2f2-e0ab873571a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:19.008850 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0ba7ddb-63ac-48d3-8d4d-95dcf7028a4c req-a90089b7-fc26-45a4-90ec-416da0516a32 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1926241
Jun 01 12:35:19.024415 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a780cc79-325d-4064-a2f2-e0ab873571a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:19.174320 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a780cc79-325d-4064-a2f2-e0ab873571a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:19.179421 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-caf459cb-e381-4d9d-b6ae-2ae787e169e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:19.190508 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a780cc79-325d-4064-a2f2-e0ab873571a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de50eaa4-a3bf-4759-a88d-8d7b9340af89,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:19.195276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a780cc79-325d-4064-a2f2-e0ab873571a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:19.200613 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a780cc79-325d-4064-a2f2-e0ab873571a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:19.206926 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a780cc79-325d-4064-a2f2-e0ab873571a2 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/de50eaa4-a3bf-4759-a88d-8d7b9340af89 HTTP/1.1" status: 204  len: 168 time: 0.4107394
Jun 01 12:35:19.271935 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e839a0>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '595e28eb-9603-4a2e-91e7-06615e85864e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'floating_ip_address': '172.27.3.247', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'port_id': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 130, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'mac_address': 'fa:16:3e:16:4f:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:34:43Z', 'updated_at': '2021-06-01T12:35:15Z', 'revision_number': 1, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:19.279659 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d0954d1-fff8-4b80-8631-cc6a33b483ae None None] The sync data for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi is: [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '595e28eb-9603-4a2e-91e7-06615e85864e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'floating_ip_address': '172.27.3.247', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'port_id': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 130, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'mac_address': 'fa:16:3e:16:4f:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:34:43Z', 'updated_at': '2021-06-01T12:35:15Z', 'revision_number': 1, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:35:19.610295 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41f81824-c9d0-4727-9535-21d3b7c3d1b1 None None] New status for floating IP 595e28eb-9603-4a2e-91e7-06615e85864e: ACTIVE {{(pid=91980) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:35:19.733853 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56558) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:19.946808 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:19.990183 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:20.001828 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Usage tracker for resource:security_group_rule and tenant:ef970ad5982e438780c2bfbb76d2fe16 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:20.005321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:20.015142 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:20.103256 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c418269f-ad64-4517-9ed3-774e2a114efb req-79f5ba1a-5046-4521-8309-19cb3198ecb2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:20.104924 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c418269f-ad64-4517-9ed3-774e2a114efb req-79f5ba1a-5046-4521-8309-19cb3198ecb2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1187940
Jun 01 12:35:20.161047 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:20.166826 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:20.175608 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c418269f-ad64-4517-9ed3-774e2a114efb req-7b95a5f9-753b-4985-999c-18556bfdee88 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0637636
Jun 01 12:35:20.177001 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6a8f8e0a-4eb4-4d8f-89e0-46baf7673cc8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:20.221597 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ef970ad5982e438780c2bfbb76d2fe16&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4844196
Jun 01 12:35:20.221597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=797b27b2-a8df-4c68-9248-63d0d4cc7cdb,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:20.222028 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56578) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:20.234755 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bf806e51-4555-4df4-a432-3f14868b22fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:20.299977 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:20.337489 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:20.418807 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:20.426779 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b5c35f9b-85a3-4580-801f-b6fc1c46a2d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:20.439810 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=797b27b2-a8df-4c68-9248-63d0d4cc7cdb,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:20.441588 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:20.457975 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:20.460921 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/797b27b2-a8df-4c68-9248-63d0d4cc7cdb HTTP/1.1" status: 204  len: 168 time: 0.2376888
Jun 01 12:35:20.999589 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56610) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:21.026048 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:21.046923 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:21.070419 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Usage tracker for resource:security_group_rule and tenant:9907d9b31a9f4ba1b5e6b801cd051cd1 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:21.079366 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:21.094386 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:21.257007 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:21.264463 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:21.299418 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-37c4b09d-a267-445c-a64f-68efb204a3d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:21.337654 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=9907d9b31a9f4ba1b5e6b801cd051cd1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3369410
Jun 01 12:35:21.338586 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e61a3540-8982-4c76-a4e1-6e43e58aba91,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:21.340392 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56628) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:21.343201 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:21.460752 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:21.531356 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:21.703888 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:21.715515 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-85913c22-62d1-4601-b990-504e6c90b658 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:21.758528 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e61a3540-8982-4c76-a4e1-6e43e58aba91,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:21.768533 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:21.782908 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:21.787118 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/e61a3540-8982-4c76-a4e1-6e43e58aba91 HTTP/1.1" status: 204  len: 168 time: 0.4439402
Jun 01 12:35:21.810302 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e605dd4-ee33-4a8e-897b-a2e986ea2e92 req-b505bfa6-ddb9-4519-84e2-b28665e0df9e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:21.819236 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8e605dd4-ee33-4a8e-897b-a2e986ea2e92 req-b505bfa6-ddb9-4519-84e2-b28665e0df9e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.2795105
Jun 01 12:35:21.919212 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8e605dd4-ee33-4a8e-897b-a2e986ea2e92 req-8e00660f-4cd1-4440-b9fa-3eb43ab45cee tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0983164
Jun 01 12:35:22.256630 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db056a8-26ab-43f8-8fdc-af1a2649526a req-2cd69ef7-e3f3-41ac-8ccb-d52b6200c3d3 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:22.260040 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2db056a8-26ab-43f8-8fdc-af1a2649526a req-2cd69ef7-e3f3-41ac-8ccb-d52b6200c3d3 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.1576710
Jun 01 12:35:22.358236 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2db056a8-26ab-43f8-8fdc-af1a2649526a req-921cd48f-a309-461c-bc51-caff0c3d9bad tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0884459
Jun 01 12:35:23.266203 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4946c638-96e1-4575-9382-84279c67220a req-076e01db-00ae-4878-a545-817699d2aa6e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:23.267922 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4946c638-96e1-4575-9382-84279c67220a req-076e01db-00ae-4878-a545-817699d2aa6e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1917260
Jun 01 12:35:23.324832 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4946c638-96e1-4575-9382-84279c67220a req-033f961f-cf98-4a9a-800a-7d37c7cc422d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462701
Jun 01 12:35:23.701166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e177b50-a4bc-4686-aa6a-d682a5c126b0 req-d188c908-ef9b-4344-981c-c87cdb008f88 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:23.703188 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3e177b50-a4bc-4686-aa6a-d682a5c126b0 req-d188c908-ef9b-4344-981c-c87cdb008f88 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.1314936
Jun 01 12:35:23.792807 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3e177b50-a4bc-4686-aa6a-d682a5c126b0 req-9903e3ac-0f92-4f88-b06f-49d892dd82fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0824726
Jun 01 12:35:24.674581 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a06015-0cc3-41c0-994e-5a4a1c046368 req-8b9aef72-4123-4f66-83e9-c79ceaf0e684 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:24.676260 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d6a06015-0cc3-41c0-994e-5a4a1c046368 req-8b9aef72-4123-4f66-83e9-c79ceaf0e684 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1984820
Jun 01 12:35:24.689851 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-f3b5f8f3-dc31-4021-94ec-b744c401b356 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:24.692387 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-f3b5f8f3-dc31-4021-94ec-b744c401b356 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.95 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.1717577
Jun 01 12:35:24.845392 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d6a06015-0cc3-41c0-994e-5a4a1c046368 req-c592db13-a637-4462-8407-1aa43d5b29ba tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1513243
Jun 01 12:35:24.982487 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Deleting port ce676d5b-517e-484e-a826-9939cb57df33 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:35:24.982897 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:25.203105 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d17f0c-c0c7-493a-bda4-df1f0576bfa9 req-ec708273-cb6f-43e4-a753-da5406eb4a97 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:25.210176 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-33d17f0c-c0c7-493a-bda4-df1f0576bfa9 req-ec708273-cb6f-43e4-a753-da5406eb4a97 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 946 time: 0.1532977
Jun 01 12:35:25.242230 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] For port ce676d5b-517e-484e-a826-9939cb57df33, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=ce676d5b-517e-484e-a826-9939cb57df33,segment=NetworkSegment(1a6e7042-c02d-4865-b6a5-545f1bab5372),segment_id=1a6e7042-c02d-4865-b6a5-545f1bab5372)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:35:25.242874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:25.302267 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-33d17f0c-c0c7-493a-bda4-df1f0576bfa9 req-cd226c1e-8531-4589-9c87-3922302a8f51 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/security-groups?id=538b550e-9c64-4230-9180-96075133d64f&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0755556
Jun 01 12:35:25.385748 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Calling delete_port for ce676d5b-517e-484e-a826-9939cb57df33 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:35:25.440714 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56802) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:25.587002 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:25.594692 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:25.604328 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:25.605276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-34aedc11-0ac1-4f35-88fc-a4bc1809df4f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:25.608644 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Usage tracker for resource:security_group_rule and tenant:86cb27a808bd4fd6957c3247171a4ab0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:25.612566 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['ce676d5b-517e-484e-a826-9939cb57df33'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:35:25.615700 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:25.641594 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:25.705541 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Pushing event deleted for resources: {'Port': ['ID=ce676d5b-517e-484e-a826-9939cb57df33,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:25.710450 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:25.791500 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:25.801813 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:25.814217 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-037dc251-ea34-4338-8b4b-70ca57e2a17f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:25.844382 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] No DVR routers for this DVR port ce676d5b-517e-484e-a826-9939cb57df33 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:35:25.850684 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:25.866358 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'name': 'network-vif-deleted', 'tag': 'ce676d5b-517e-484e-a826-9939cb57df33'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:35:25.869768 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f1012eb-41f5-4fb2-bfee-02e992563171" -d '{"events": [{"server_uuid": "8a67e00f-6966-4f2f-98ab-3e852efdbf7d", "name": "network-vif-deleted", "tag": "ce676d5b-517e-484e-a826-9939cb57df33"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:35:25.878284 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-988275e1-8b3b-427c-8e79-489d9bab5b13 req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.95 "DELETE /v2.0/ports/ce676d5b-517e-484e-a826-9939cb57df33 HTTP/1.1" status: 204  len: 173 time: 1.1548858
Jun 01 12:35:25.924541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3975a5d-543c-4d57-abe4-4def4a22ff32,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:25.928240 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:25.933106 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=86cb27a808bd4fd6957c3247171a4ab0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4911566
Jun 01 12:35:25.934579 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56822) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:25.980549 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:35:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79f35f9a-aec5-4ecf-97dd-57122762000c x-openstack-request-id: req-79f35f9a-aec5-4ecf-97dd-57122762000c {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:35:25.981287 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a67e00f-6966-4f2f-98ab-3e852efdbf7d", "name": "network-vif-deleted", "tag": "ce676d5b-517e-484e-a826-9939cb57df33", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:35:25.981888 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-79f35f9a-aec5-4ecf-97dd-57122762000c {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:35:25.982719 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8a67e00f-6966-4f2f-98ab-3e852efdbf7d', 'name': 'network-vif-deleted', 'tag': 'ce676d5b-517e-484e-a826-9939cb57df33', 'status': 'completed', 'code': 200}
Jun 01 12:35:26.047138 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:26.145041 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:26.244038 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be303eb-7da3-4663-a0f8-2e78926b068b req-0559fe58-3838-44f5-9162-66df501427c0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:26.246056 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1be303eb-7da3-4663-a0f8-2e78926b068b req-0559fe58-3838-44f5-9162-66df501427c0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1553621
Jun 01 12:35:26.316618 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:26.348587 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-cc28966d-11f3-4885-9d08-984c4a34ec2d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:26.368911 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1be303eb-7da3-4663-a0f8-2e78926b068b req-ea05b47b-8715-4566-8d60-90effeafb580 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0986388
Jun 01 12:35:26.393496 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3975a5d-543c-4d57-abe4-4def4a22ff32,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:26.398024 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:26.400672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:26.402605 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/e3975a5d-543c-4d57-abe4-4def4a22ff32 HTTP/1.1" status: 204  len: 168 time: 0.4668968
Jun 01 12:35:26.713389 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0de3c30c-6b3e-4fd5-b527-840647798be8 req-0b0d8177-a835-463b-afc2-f2d7f2d8ce09 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] 10.222.0.81 "GET /v2.0/ports?device_id=8a67e00f-6966-4f2f-98ab-3e852efdbf7d HTTP/1.1" status: 200  len: 210 time: 0.1218948
Jun 01 12:35:26.960376 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56850) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:26.982183 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:27.000196 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:27.004738 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Usage tracker for resource:security_group_rule and tenant:eb549e18bbd5473fb656dcfc524f4579 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:27.008748 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:27.016774 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:27.134551 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:27.146433 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:27.156466 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:27.203604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6127449-2798-473d-980c-0cf3ef746470,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:27.206794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:27.212862 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 56858) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:27.223374 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=eb549e18bbd5473fb656dcfc524f4579&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2611239
Jun 01 12:35:27.282303 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:27.313722 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:27.413871 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:27.418323 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f6e72aad-1167-4f92-baab-71db5dfb19ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:27.440447 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6127449-2798-473d-980c-0cf3ef746470,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:27.447169 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:27.475783 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:27.476886 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b6127449-2798-473d-980c-0cf3ef746470 HTTP/1.1" status: 204  len: 168 time: 0.2619805
Jun 01 12:35:27.749469 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device ce676d5b-517e-484e-a826-9939cb57df33 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:35:27.897951 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: ce676d5b-517e-484e-a826-9939cb57df33 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:35:27.899032 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device ce676d5b-517e-484e-a826-9939cb57df33 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:35:27.989894 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5eb25db-b45b-4494-9db4-dce1c9407d31 req-efecbe5a-8848-48e2-91fe-18160fc7e236 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:27.993185 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e5eb25db-b45b-4494-9db4-dce1c9407d31 req-efecbe5a-8848-48e2-91fe-18160fc7e236 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.2518141
Jun 01 12:35:28.084541 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e5eb25db-b45b-4494-9db4-dce1c9407d31 req-d18c011a-a4a3-478d-b938-149e9ba25f6c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0822334
Jun 01 12:35:29.331921 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df43ec6-fc49-46e1-b562-3dfe035d2e06 req-5c4f5877-1660-4f5c-beaf-b7a8292660e4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:29.334949 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0df43ec6-fc49-46e1-b562-3dfe035d2e06 req-5c4f5877-1660-4f5c-beaf-b7a8292660e4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1045072
Jun 01 12:35:29.399278 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0df43ec6-fc49-46e1-b562-3dfe035d2e06 req-8d89abd4-ef06-42fa-81cf-37ba1f1e853e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0546381
Jun 01 12:35:30.210014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56966) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:30.366604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_v2 [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Deleting subnet cdf0cb8d-bdfe-4594-b297-e53e395b7d22 {{(pid=91979) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:35:30.369890 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:30.429239 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:30.438995 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:30.739923 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c6b4ae1-38ea-4849-9172-19e5f847a1f9 req-85eac8c1-58a7-41d3-9ee6-1328e4e2762d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:30.741842 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4c6b4ae1-38ea-4849-9172-19e5f847a1f9 req-85eac8c1-58a7-41d3-9ee6-1328e4e2762d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1825151
Jun 01 12:35:30.798302 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4c6b4ae1-38ea-4849-9172-19e5f847a1f9 req-f206ebe0-f915-4c8d-8797-cac03273dfa3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485671
Jun 01 12:35:30.806274 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:30.814242 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e072e9ce-e087-4ebb-ba27-b9d04d492c79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:30.863361 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cdf0cb8d-bdfe-4594-b297-e53e395b7d22,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:30.878179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:30.899054 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/cdf0cb8d-bdfe-4594-b297-e53e395b7d22 HTTP/1.1" status: 204  len: 168 time: 0.6853538
Jun 01 12:35:30.899054 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:30.899541 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 56980) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:31.027469 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.213610 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.228672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f7a252f8d30>> segment before_delete 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.229305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f7a252f8d30>> subnet precommit_delete_associations 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.229798 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> segment_host_mapping after_create 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.230357 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> port after_create 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.230836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> port after_delete 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.231352 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> port after_update 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.231821 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> segment after_delete 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.232193 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> subnet after_create 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.232724 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> subnet after_delete 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.233618 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a2548d8b0>> subnet after_update 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.545800 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25184580>> subnet after_create 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.546935 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25184580>> subnet after_delete 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.547244 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25184580>> subnet before_create 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.547244 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25184580>> subnet before_update 55550000 {{(pid=91979) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:31.548217 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a25092d60>,) {'filters': {'network_id': ['53a16a0a-0d86-46d5-81e4-dff69599238d']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:31.560107 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57022) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:31.566093 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25092d60>, '1a6e7042-c02d-4865-b6a5-545f1bab5372') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:31.566384 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25092d60>, '1a6e7042-c02d-4865-b6a5-545f1bab5372') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:31.628712 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.655740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.664856 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_v2 [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Deleting subnet 9a5ece44-875e-439b-8b09-f33e94bd16f6 {{(pid=91979) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:35:31.669353 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.695937 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Releasing vlan 786 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:35:31.696341 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   from cryptography.utils import int_from_bytes
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   from cryptography.utils import int_from_bytes
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:35:31.712784 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:35:31.805943 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2204557'] for subnet, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.854386 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.865923 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:31.879305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:31.907627 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] 10.222.0.81 "DELETE /v2.0/networks/53a16a0a-0d86-46d5-81e4-dff69599238d HTTP/1.1" status: 204  len: 168 time: 1.0065837
Jun 01 12:35:31.911747 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Pushing event deleted for resources: {'Network': ['ID=53a16a0a-0d86-46d5-81e4-dff69599238d,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:31.915804 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:31.930134 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.061183 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c565fe8a-a723-4f14-b72d-3c2728f57c1e req-9b44ecae-6c96-459c-9685-03ee10ce88bc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:32.062688 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c565fe8a-a723-4f14-b72d-3c2728f57c1e req-9b44ecae-6c96-459c-9685-03ee10ce88bc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0854683
Jun 01 12:35:32.113505 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c565fe8a-a723-4f14-b72d-3c2728f57c1e req-98354223-1c3b-4dd8-ac32-7927fd7b5481 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442202
Jun 01 12:35:32.151597 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57034) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:32.208785 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-fe4241b5-6e7b-4556-b4ba-472a39a88fe7 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ac8957d6acd0419f9863ee5fadc5649b&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0559030
Jun 01 12:35:32.210995 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2610798', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2345669'] for subnet, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.211684 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57038) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:32.216014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-63de180a-969c-46a8-86a3-1f1ad787dd65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:32.254815 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9a5ece44-875e-439b-8b09-f33e94bd16f6,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:32.257446 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:32.261562 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.268197 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/9a5ece44-875e-439b-8b09-f33e94bd16f6 HTTP/1.1" status: 204  len: 168 time: 0.7069995
Jun 01 12:35:32.270561 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57042) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:32.277874 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.313859 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.374565 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.378610 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-28a0b345-2cb3-4ee9-aeff-60b7396e16be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:32.390346 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=538b550e-9c64-4230-9180-96075133d64f,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:32.395564 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:32.402285 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.408422 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.409687 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/538b550e-9c64-4230-9180-96075133d64f HTTP/1.1" status: 204  len: 168 time: 0.1970425
Jun 01 12:35:32.618263 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.640413 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a25afebb0>,) {'filters': {'network_id': ['f19259de-17ac-4f4f-904d-a0093269aa55']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:32.655394 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25afebb0>, 'c82095c1-0e47-40a0-98c4-b0d498e59e78') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:32.655683 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25afebb0>, 'c82095c1-0e47-40a0-98c4-b0d498e59e78') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:32.671548 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.693909 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.701702 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Releasing vlan 769 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:35:32.702469 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:35:32.728391 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:35:32.812301 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.816878 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-745beec5-f133-45c3-92c1-4ff7107f11c1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:32.832334 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:32.842091 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Pushing event deleted for resources: {'Network': ['ID=f19259de-17ac-4f4f-904d-a0093269aa55,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:32.848586 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] 10.222.0.81 "DELETE /v2.0/networks/f19259de-17ac-4f4f-904d-a0093269aa55 HTTP/1.1" status: 204  len: 168 time: 0.5727930
Jun 01 12:35:32.848586 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:32.851009 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57068) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:32.937344 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Deleting subnet 04b8601d-8e49-48f4-b84c-89f757a89dd3 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:35:32.944084 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.018810 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.028949 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.385097 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.393314 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e0de0675-84c2-4ef8-8d59-072802a4f960 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:33.433308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57100) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:33.436407 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=04b8601d-8e49-48f4-b84c-89f757a89dd3,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:33.450057 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.466590 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5687258e-5bf7-47cd-9195-96334ec98534 req-7da35e60-0d11-4532-a555-18c3db4cea3b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:33.468116 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5687258e-5bf7-47cd-9195-96334ec98534 req-7da35e60-0d11-4532-a555-18c3db4cea3b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1892979
Jun 01 12:35:33.472930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57108) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:33.473369 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/04b8601d-8e49-48f4-b84c-89f757a89dd3 HTTP/1.1" status: 204  len: 168 time: 0.6200786
Jun 01 12:35:33.497268 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:33.526123 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5687258e-5bf7-47cd-9195-96334ec98534 req-48baf131-8fd8-4b8c-b96d-ccfd49511438 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470850
Jun 01 12:35:33.570169 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-964726892-network', 'tenant_id': 'ab8ea958183f4942be87eaaa2e348325'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:33.588838 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:33.595781 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Usage tracker for resource:network and tenant:ab8ea958183f4942be87eaaa2e348325 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:33.606254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:33.614533 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:33.623612 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.632777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Made reservation on behalf of ab8ea958183f4942be87eaaa2e348325 for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:33.634969 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.649877 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.703851 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:33.712728 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Usage tracker for resource:security_group_rule and tenant:ab8ea958183f4942be87eaaa2e348325 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:33.717282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:33.777610 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:33.792041 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.812977 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a250c3940>,) {'filters': {'network_id': ['1f07c5f0-c38d-4387-a9df-bf257dfdcbbe']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:33.829264 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a250c3940>, 'bd382fab-27c0-4c70-bd61-e318bee7363d') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:33.829572 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a250c3940>, 'bd382fab-27c0-4c70-bd61-e318bee7363d') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:33.846518 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.873101 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.884431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Releasing vlan 777 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:35:33.884863 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:35:33.898106 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:35:33.996322 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.004667 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ea68965-d825-4ac3-819a-3342388b12af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:34.018354 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.019668 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.029915 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.035589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Pushing event deleted for resources: {'Network': ['ID=1f07c5f0-c38d-4387-a9df-bf257dfdcbbe,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:34.040373 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:34.041222 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bacb6e0d-318c-48a4-a9f2-96b16258d399 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:34.049068 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c303d8e2-0e4a-4ecc-926f-abd5eac5acbf admin admin] 10.222.0.81 "DELETE /v2.0/networks/1f07c5f0-c38d-4387-a9df-bf257dfdcbbe HTTP/1.1" status: 204  len: 168 time: 0.5743065
Jun 01 12:35:34.061257 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] vlan segment allocate from pool success with {'vlan_id': 775, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:35:34.082737 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17cbf09d-b3c7-4fde-bdeb-9d2dae617e75,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:34.085432 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.085766 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Added segment 463a905c-992c-4bbb-82a9-61d653fa3736 of type vlan for network 8938a1bb-69dd-468c-94b5-7ee0ece8f121
Jun 01 12:35:34.091572 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:34.128645 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.162476 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.163999 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:34.168797 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.168797 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:34.224745 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57120) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:34.257048 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 0.8221767
Jun 01 12:35:34.260018 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57124) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:34.269610 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Pushing event updated for resources: {'Network': ['ID=8938a1bb-69dd-468c-94b5-7ee0ece8f121,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:34.272255 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Request body: {'subnet': {'network_id': '8938a1bb-69dd-468c-94b5-7ee0ece8f121', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-964726892-subnet', 'tenant_id': 'ab8ea958183f4942be87eaaa2e348325', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:34.272535 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:34.279885 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 8938a1bb-69dd-468c-94b5-7ee0ece8f121 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:35:34.283093 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:34.289714 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a77f541d-449c-4942-81ab-ca2e4b24dfd9 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=9bfc9ce553aa4aad8cea2b35857daf79&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0636854
Jun 01 12:35:34.290826 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Usage tracker for resource:subnet and tenant:ab8ea958183f4942be87eaaa2e348325 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:34.292442 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57128) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:34.294022 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:34.300699 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:34.313446 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Made reservation on behalf of ab8ea958183f4942be87eaaa2e348325 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:34.316007 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.360223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.395319 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.462733 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.467110 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e82401da-6213-4447-80dc-57243a297779 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:34.478473 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5347de1b-b95d-4756-812e-5528e3f2330d,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:34.480906 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:34.496415 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:34.498745 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/5347de1b-b95d-4756-812e-5528e3f2330d HTTP/1.1" status: 204  len: 168 time: 0.2041743
Jun 01 12:35:34.874259 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b7a96b8-ebad-4fe4-94a3-bc56427a9b05 req-8ed39a68-13c2-469f-a338-a5d92032bb24 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:34.876882 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6b7a96b8-ebad-4fe4-94a3-bc56427a9b05 req-8ed39a68-13c2-469f-a338-a5d92032bb24 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1894691
Jun 01 12:35:34.905910 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57142) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:34.973844 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6b7a96b8-ebad-4fe4-94a3-bc56427a9b05 req-901cb3bc-6bde-4181-92a2-83166f816746 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0805397
Jun 01 12:35:34.985755 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6dee503e-0676-45cd-909b-d96ee5bc8ba9 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=151465a92b184a54ab5244ea4f7838b4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0781004
Jun 01 12:35:34.990983 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57148) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:35.044773 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:35.049672 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:35.101749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:35.125547 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Pushing event updated for resources: {'Subnet': ['ID=11d67be9-62a2-4562-8e22-9e8869d0d339,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:35.128772 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:35.137159 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Checking segment: {'id': '463a905c-992c-4bbb-82a9-61d653fa3736', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': '8938a1bb-69dd-468c-94b5-7ee0ece8f121'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:35:35.137592 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Network hostable DHCP agents. Network: 8938a1bb-69dd-468c-94b5-7ee0ece8f121, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:35:35.142431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:35.157677 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Network 8938a1bb-69dd-468c-94b5-7ee0ece8f121 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:35:35.169135 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 8938a1bb-69dd-468c-94b5-7ee0ece8f121) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:35:35.178347 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-537f7d5e-4875-4f46-8698-cd7af5be3c9e None None] Network 8938a1bb-69dd-468c-94b5-7ee0ece8f121 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:35.181045 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:35.181720 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:35.225572 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 0.9641945
Jun 01 12:35:35.249742 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:35.256592 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:35.271975 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5bac8cd3-5c0c-4fe6-93c3-26dc2bc6d27f,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:35.276487 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:35.279808 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:35.281330 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/5bac8cd3-5c0c-4fe6-93c3-26dc2bc6d27f HTTP/1.1" status: 204  len: 168 time: 0.2887261
Jun 01 12:35:35.467672 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86275de3-fa56-4087-a004-33b568b09b7a None None] Network 8938a1bb-69dd-468c-94b5-7ee0ece8f121 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:36.232546 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57198) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:36.242929 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1951965965-network', 'tenant_id': 'f2c1300456bc4197b0ee062fc4fca30c'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:36.269761 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:36.292154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Usage tracker for resource:network and tenant:f2c1300456bc4197b0ee062fc4fca30c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:36.306352 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:36.336898 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:36.368718 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Made reservation on behalf of f2c1300456bc4197b0ee062fc4fca30c for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:36.374979 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.401291 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.424315 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a2d446-041f-48e8-9364-ce4079a9e400 req-734cd5b2-d88c-4a38-93e8-9c746cad16d4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:36.432753 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:36.436557 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c7a2d446-041f-48e8-9364-ce4079a9e400 req-734cd5b2-d88c-4a38-93e8-9c746cad16d4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.2061965
Jun 01 12:35:36.440904 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Usage tracker for resource:security_group_rule and tenant:f2c1300456bc4197b0ee062fc4fca30c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:36.446180 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:36.458226 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:36.572635 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c7a2d446-041f-48e8-9364-ce4079a9e400 req-880f3e41-1443-422f-951b-87922f78e010 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1347787
Jun 01 12:35:36.686620 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.692403 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.697792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-55414a32-3603-4bd6-b901-7150a5f76c79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:36.727471 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] vlan segment allocate from pool success with {'vlan_id': 754, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:35:36.736453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4067e6ba-f4f5-45ef-9bb4-ebf6af2a80d3,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:36.740110 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:36.743091 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.743674 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Added segment 5adcb771-42fa-4d6c-886f-830031d06195 of type vlan for network 301a7baa-42e3-4231-b925-ac6e0d87c1ad
Jun 01 12:35:36.780434 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.833906 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.835442 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:36.836120 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:36.842209 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:36.943639 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Pushing event updated for resources: {'Network': ['ID=301a7baa-42e3-4231-b925-ac6e0d87c1ad,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:36.946693 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 0.7123866
Jun 01 12:35:36.947576 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:36.949334 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57224) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:36.955249 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Request body: {'subnet': {'network_id': '301a7baa-42e3-4231-b925-ac6e0d87c1ad', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1951965965-subnet', 'tenant_id': 'f2c1300456bc4197b0ee062fc4fca30c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:35:36.957075 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 301a7baa-42e3-4231-b925-ac6e0d87c1ad details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:35:36.960969 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:36.965154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Usage tracker for resource:subnet and tenant:f2c1300456bc4197b0ee062fc4fca30c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:36.968100 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:36.975086 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:36.986794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Made reservation on behalf of f2c1300456bc4197b0ee062fc4fca30c for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:35:36.989845 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2345690'] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:37.504794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2610733', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2345676'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:37.509083 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e8123585-4e91-4ccc-b99d-baad5284b158 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:37.591746 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Pushing event updated for resources: {'Subnet': ['ID=7051612c-d711-4179-bff4-945583787862,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:37.594511 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:37.601449 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Checking segment: {'id': '5adcb771-42fa-4d6c-886f-830031d06195', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '301a7baa-42e3-4231-b925-ac6e0d87c1ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:35:37.601803 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Network hostable DHCP agents. Network: 301a7baa-42e3-4231-b925-ac6e0d87c1ad, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:35:37.621665 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Network 301a7baa-42e3-4231-b925-ac6e0d87c1ad is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:35:37.637147 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 301a7baa-42e3-4231-b925-ac6e0d87c1ad) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:35:37.656447 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2021109-264b-4e8f-bdc3-cf56422b6865 None None] Network 301a7baa-42e3-4231-b925-ac6e0d87c1ad requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:37.657074 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:37.658008 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:37.704743 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 0.7540693
Jun 01 12:35:37.835863 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb98bc45-f896-4521-85bf-c996aa546126 req-db90ebd8-2fe1-4423-b0f9-8e21732159e8 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:37.837443 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bb98bc45-f896-4521-85bf-c996aa546126 req-db90ebd8-2fe1-4423-b0f9-8e21732159e8 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1009901
Jun 01 12:35:37.862833 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57246) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:37.893425 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3aa366ad-1136-4d5c-af26-6fd23d2cca66 None None] Network 301a7baa-42e3-4231-b925-ac6e0d87c1ad requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:35:37.939258 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bb98bc45-f896-4521-85bf-c996aa546126 req-9d8f7b49-8ff3-4e56-8531-762ffb0dc97d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0955312
Jun 01 12:35:37.952806 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Deleting subnet 11d67be9-62a2-4562-8e22-9e8869d0d339 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:35:37.956759 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.015137 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.022902 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.279099 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.282978 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bbe891bd-9b71-412a-abdd-1bf138564a36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:38.318315 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=11d67be9-62a2-4562-8e22-9e8869d0d339,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:38.321150 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:38.322127 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.328283 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/11d67be9-62a2-4562-8e22-9e8869d0d339 HTTP/1.1" status: 204  len: 168 time: 0.4634871
Jun 01 12:35:38.330798 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57250) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:38.435971 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.558792 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.571395 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f7a2539cca0>> segment before_delete 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.571724 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f7a2539cca0>> subnet precommit_delete_associations 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.572448 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> segment_host_mapping after_create 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.572804 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> port after_create 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.573115 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> port after_delete 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.573454 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> port after_update 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.573760 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> segment after_delete 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.574062 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> subnet after_create 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.574364 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> subnet after_delete 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.574667 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f7a254357f0>> subnet after_update 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.639139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25d6bbe0>> subnet after_create 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.639474 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25d6bbe0>> subnet after_delete 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.639796 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25d6bbe0>> subnet before_create 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.640126 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f7a25d6bbe0>> subnet before_update 55550000 {{(pid=91978) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
Jun 01 12:35:38.640471 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a25435640>,) {'filters': {'network_id': ['8938a1bb-69dd-468c-94b5-7ee0ece8f121']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:38.654166 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25435640>, '463a905c-992c-4bbb-82a9-61d653fa3736') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:38.654452 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25435640>, '463a905c-992c-4bbb-82a9-61d653fa3736') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:38.665613 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.682498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.689169 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Releasing vlan 775 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:35:38.689581 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   from cryptography.utils import int_from_bytes
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   from cryptography.utils import int_from_bytes
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:35:38.705153 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:35:38.783801 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.787963 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e2f78d8d-f0d9-47df-a4fc-2d18597ca6c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:38.803360 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.809648 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Pushing event deleted for resources: {'Network': ['ID=8938a1bb-69dd-468c-94b5-7ee0ece8f121,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:38.812324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:38.814089 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] 10.222.0.81 "DELETE /v2.0/networks/8938a1bb-69dd-468c-94b5-7ee0ece8f121 HTTP/1.1" status: 204  len: 168 time: 0.4824204
Jun 01 12:35:38.817048 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57262) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:38.881303 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Deleting subnet 7051612c-d711-4179-bff4-945583787862 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:35:38.884443 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.933252 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:38.987307 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.274571 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cabc86e-621b-4336-963a-74d2c272ae5d req-b7fbc254-7d49-4a40-817f-09f824a5184d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:39.276148 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0cabc86e-621b-4336-963a-74d2c272ae5d req-b7fbc254-7d49-4a40-817f-09f824a5184d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.2005157
Jun 01 12:35:39.375728 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0cabc86e-621b-4336-963a-74d2c272ae5d req-012ea747-4381-4f1c-b826-0c3e3d50abbb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0860548
Jun 01 12:35:39.402030 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.406204 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:39.441454 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7051612c-d711-4179-bff4-945583787862,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:39.444617 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:39.445720 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.453236 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-be795114-d705-4a16-8183-e9f7e8ee129f admin admin] 10.222.0.81 "DELETE /v2.0/subnets/7051612c-d711-4179-bff4-945583787862 HTTP/1.1" status: 204  len: 168 time: 0.6352055
Jun 01 12:35:39.455693 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57272) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:39.567037 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.696659 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.710467 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a25421b50>,) {'filters': {'network_id': ['301a7baa-42e3-4231-b925-ac6e0d87c1ad']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:39.730938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25421b50>, '5adcb771-42fa-4d6c-886f-830031d06195') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:39.731224 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25421b50>, '5adcb771-42fa-4d6c-886f-830031d06195') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:35:39.743975 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.765729 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.773585 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Releasing vlan 754 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:35:39.773901 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:35:39.788094 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:35:39.857607 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-445f0dfd-5d48-49ad-beb3-1d03f176e1df None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.879502 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.892269 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:39.908252 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-ad939b34-0978-4c5d-a0d5-fe66a10a44c1 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0926776
Jun 01 12:35:39.908873 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:39.919367 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Pushing event deleted for resources: {'Network': ['ID=301a7baa-42e3-4231-b925-ac6e0d87c1ad,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:39.923722 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] 10.222.0.81 "DELETE /v2.0/networks/301a7baa-42e3-4231-b925-ac6e0d87c1ad HTTP/1.1" status: 204  len: 168 time: 0.4670753
Jun 01 12:35:39.924669 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-79e73a96-694f-4eab-b9e9-028880f84c2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:40.062752 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-09dbcd43-efe6-493f-8fba-7c90b0361bad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:40.064220 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-09dbcd43-efe6-493f-8fba-7c90b0361bad service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.0855291
Jun 01 12:35:40.118573 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57290) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:40.174925 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0e0b5fdb-1d2a-4751-89e3-85c615e364ee admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ab8ea958183f4942be87eaaa2e348325&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0531380
Jun 01 12:35:40.175598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57294) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:40.265887 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-b33c90ab-66f3-4c54-b33a-b8ebce8377da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:40.267363 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-b33c90ab-66f3-4c54-b33a-b8ebce8377da service neutron] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 920 time: 0.1748166
Jun 01 12:35:40.339344 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:40.353578 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-dcf4cb03-6129-42f5-b146-e42924a7eb28 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 200  len: 217 time: 0.0734286
Jun 01 12:35:40.424228 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:40.467033 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-8af1f43b-c104-4283-87a6-f4beffa008ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:40.468817 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-8af1f43b-c104-4283-87a6-f4beffa008ad service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.1058898
Jun 01 12:35:40.523173 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-a33a1b70-7903-4ab7-936c-78150731b2a6 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0479403
Jun 01 12:35:40.571420 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae25349-6ed9-410b-be47-0f6ba66d63c4 req-63c5f448-9fa1-4853-ab90-30a87d84f584 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:40.573426 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bae25349-6ed9-410b-be47-0f6ba66d63c4 req-63c5f448-9fa1-4853-ab90-30a87d84f584 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0886686
Jun 01 12:35:40.637369 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bae25349-6ed9-410b-be47-0f6ba66d63c4 req-e49ea7f4-7d24-443b-896f-1a16c6ac8994 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0563331
Jun 01 12:35:40.685002 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-301dfcbe-c1f1-4b62-9ae1-a97bd9ecf207 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1526239
Jun 01 12:35:40.686008 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:40.690749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:40.725565 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17cbf09d-b3c7-4fde-bdeb-9d2dae617e75,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:40.732754 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:40.785005 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:40.790513 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/17cbf09d-b3c7-4fde-bdeb-9d2dae617e75 HTTP/1.1" status: 204  len: 168 time: 0.6095192
Jun 01 12:35:40.889184 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f05322f4-48cd-49a6-bd42-f02fed91a817 req-85d27066-406c-45fe-a561-2d7796bf6c79 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1853838
Jun 01 12:35:41.428500 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57336) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:41.484905 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a6544165-a41e-47a5-9916-ec181593b461 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f2c1300456bc4197b0ee062fc4fca30c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0551617
Jun 01 12:35:41.487313 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57340) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:41.562777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:41.591964 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:41.687758 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:41.706313 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:41.737272 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4067e6ba-f4f5-45ef-9bb4-ebf6af2a80d3,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:41.741974 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:41.745171 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:41.747941 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4067e6ba-f4f5-45ef-9bb4-ebf6af2a80d3 HTTP/1.1" status: 204  len: 168 time: 0.2593906
Jun 01 12:35:41.947412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9eb63b0-7337-4e3f-b919-63ab2e087d57 req-43ab22b8-29b0-4df8-9437-e599e327484b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:41.957673 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e9eb63b0-7337-4e3f-b919-63ab2e087d57 req-43ab22b8-29b0-4df8-9437-e599e327484b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1333554
Jun 01 12:35:42.072273 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:42.097019 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e9eb63b0-7337-4e3f-b919-63ab2e087d57 req-4508868d-e16b-42e4-8953-5176063f28f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1359365
Jun 01 12:35:42.334519 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:42.671511 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-23eda362-658b-44fd-87d1-3cfdbef3ca52 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:42.873226 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:35:43.319243 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b975e8f-ae68-45e5-97c5-5a89c87c551f req-f794f25a-8736-4c9b-b939-148d993299a4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:43.321466 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8b975e8f-ae68-45e5-97c5-5a89c87c551f req-f794f25a-8736-4c9b-b939-148d993299a4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1002223
Jun 01 12:35:43.382317 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8b975e8f-ae68-45e5-97c5-5a89c87c551f req-7e5f0c4e-2bd5-46e2-8caa-edac9322052c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471015
Jun 01 12:35:43.838384 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:44.581825 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b91e3e5-870d-4afe-a7f4-129c30b302b2 req-017a4cfd-a567-4204-bcb6-8d97d6f87081 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:44.583347 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3b91e3e5-870d-4afe-a7f4-129c30b302b2 req-017a4cfd-a567-4204-bcb6-8d97d6f87081 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0871968
Jun 01 12:35:44.630663 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3b91e3e5-870d-4afe-a7f4-129c30b302b2 req-430b0983-502a-4ba5-a22b-2e59e164dcc4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406861
Jun 01 12:35:45.377385 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:45.819328 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941b78de-a105-4151-8143-f873e194b528 req-f566f8e5-9e28-4dd9-970e-a4c3df4d3034 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:45.820951 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-941b78de-a105-4151-8143-f873e194b528 req-f566f8e5-9e28-4dd9-970e-a4c3df4d3034 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0817127
Jun 01 12:35:45.882022 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-941b78de-a105-4151-8143-f873e194b528 req-4c46d800-f915-4cfa-9cc8-ab5fbf9850f4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0551383
Jun 01 12:35:47.124632 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2754d877-8526-445d-b421-d994dfdc12ff req-08983619-2087-4800-9c4d-1bf0ce84a6c7 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:47.132633 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2754d877-8526-445d-b421-d994dfdc12ff req-08983619-2087-4800-9c4d-1bf0ce84a6c7 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1225667
Jun 01 12:35:47.179969 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2754d877-8526-445d-b421-d994dfdc12ff req-cf2c35b7-8489-4dfa-aa57-28f860948b3a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462353
Jun 01 12:35:47.444112 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57506) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:47.578368 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:47.598784 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:35:47.602819 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Usage tracker for resource:security_group_rule and tenant:90420ce971174d55a29c1547e35cf8f5 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:35:47.605697 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:35:47.611425 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:35:47.702857 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:47.707815 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:47.718506 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:47.747858 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a823b13c-3371-43ea-a813-84b625b573c6,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:47.752833 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:47.780960 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=90420ce971174d55a29c1547e35cf8f5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3351076
Jun 01 12:35:47.783081 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57522) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:35:47.858958 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:47.896838 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:47.950834 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:47.955764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-25373979-a50b-43bf-a778-e87bdf09c394 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:35:47.966157 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a823b13c-3371-43ea-a813-84b625b573c6,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:35:47.971118 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:35:47.973222 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:35:47.975167 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a823b13c-3371-43ea-a813-84b625b573c6 HTTP/1.1" status: 204  len: 168 time: 0.1907437
Jun 01 12:35:48.491139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd876a4-d3c0-492a-8920-a5af87e872dc req-7c555bea-f3ba-4483-b94e-abe53cb54860 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:48.493409 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3bd876a4-d3c0-492a-8920-a5af87e872dc req-7c555bea-f3ba-4483-b94e-abe53cb54860 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1342640
Jun 01 12:35:48.555337 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3bd876a4-d3c0-492a-8920-a5af87e872dc req-f8cc5953-981c-4494-b739-d369db6ca61c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0516362
Jun 01 12:35:49.817072 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9a4e0f-5370-4df1-9337-90b210d5aefb req-313fcea5-8235-45ff-8f14-337288e08efb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:49.818581 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-aa9a4e0f-5370-4df1-9337-90b210d5aefb req-313fcea5-8235-45ff-8f14-337288e08efb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1415656
Jun 01 12:35:49.871822 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-aa9a4e0f-5370-4df1-9337-90b210d5aefb req-3bcde43e-a7fe-4a5b-86a0-d5fa6a69a4f8 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455263
Jun 01 12:35:51.080455 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c7d1b8-b117-4f53-9a69-9c9efa7b0a0d req-ad92822e-a94d-42c6-bb21-363938de262c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:51.082053 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-44c7d1b8-b117-4f53-9a69-9c9efa7b0a0d req-ad92822e-a94d-42c6-bb21-363938de262c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0881937
Jun 01 12:35:51.140387 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-44c7d1b8-b117-4f53-9a69-9c9efa7b0a0d req-1eca2923-4c29-4fe2-b087-1a651f6092d7 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0503595
Jun 01 12:35:52.347853 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a56536f-2dd3-4545-bf7b-3d2d68323e48 req-ecd3cdd4-70eb-4cf4-9d24-e25b8bf7c335 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:52.350851 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9a56536f-2dd3-4545-bf7b-3d2d68323e48 req-ecd3cdd4-70eb-4cf4-9d24-e25b8bf7c335 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0861330
Jun 01 12:35:52.402013 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9a56536f-2dd3-4545-bf7b-3d2d68323e48 req-7549da32-5a9e-4417-9763-3b06997c6737 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0453355
Jun 01 12:35:53.596901 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f865caa-f639-4841-894c-0d0da2b27b84 req-bb950f9e-cf34-4d7b-b05f-888ae6637acb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:53.598966 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0f865caa-f639-4841-894c-0d0da2b27b84 req-bb950f9e-cf34-4d7b-b05f-888ae6637acb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0825355
Jun 01 12:35:53.642612 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0f865caa-f639-4841-894c-0d0da2b27b84 req-669feb01-1da3-43c2-bbcf-23c5207ed9a7 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380764
Jun 01 12:35:54.830305 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edcea863-977b-40dd-add8-94cb81d339ad req-d372e0e9-aabf-4c4b-a82c-060fc9c08333 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:54.831773 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-edcea863-977b-40dd-add8-94cb81d339ad req-d372e0e9-aabf-4c4b-a82c-060fc9c08333 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0822058
Jun 01 12:35:54.879515 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-edcea863-977b-40dd-add8-94cb81d339ad req-5d5bdc8e-d13f-41df-a0dd-4b3f972c0f53 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415015
Jun 01 12:35:56.079170 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc5dc89-b810-4820-9413-d0c5842f06c0 req-0d812082-1916-456f-9dbd-71a22b02987d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:56.080731 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7cc5dc89-b810-4820-9413-d0c5842f06c0 req-0d812082-1916-456f-9dbd-71a22b02987d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0906830
Jun 01 12:35:56.132670 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7cc5dc89-b810-4820-9413-d0c5842f06c0 req-8e390c09-1ed8-48a5-b0a2-6ef782bec9bf tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454504
Jun 01 12:35:57.327165 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f03ee23d-9098-4714-82fe-925355492d5b req-ba7611b7-a440-4065-b24d-0b9ab39fb933 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:57.328691 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f03ee23d-9098-4714-82fe-925355492d5b req-ba7611b7-a440-4065-b24d-0b9ab39fb933 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0818143
Jun 01 12:35:57.378941 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f03ee23d-9098-4714-82fe-925355492d5b req-51d25202-8510-402e-841e-e9d2ec6510cb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434594
Jun 01 12:35:58.578573 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560c176e-3520-4bfa-bb3b-8342080ea20c req-9e30f940-7348-4c51-bbbd-4eebbc9b5187 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:58.581101 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-560c176e-3520-4bfa-bb3b-8342080ea20c req-9e30f940-7348-4c51-bbbd-4eebbc9b5187 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0926597
Jun 01 12:35:58.630741 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-560c176e-3520-4bfa-bb3b-8342080ea20c req-d199a35e-6c5e-4100-87b0-b8544e235320 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435557
Jun 01 12:35:59.827843 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882ed6c7-6363-4f0d-8bc2-f941a228bb1f req-1a9f3e20-3c41-4f0c-88ce-e54f86a1db7d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:35:59.829403 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-882ed6c7-6363-4f0d-8bc2-f941a228bb1f req-1a9f3e20-3c41-4f0c-88ce-e54f86a1db7d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0830827
Jun 01 12:35:59.881832 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-882ed6c7-6363-4f0d-8bc2-f941a228bb1f req-940e3663-d1a4-4d14-afd8-d6a35a42e66d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0462334
Jun 01 12:36:01.068335 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bde88bc7-b376-4b9a-80ed-2dca21ac2a5d req-ed408035-1aec-4fac-8888-c68d6948527d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:01.070046 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bde88bc7-b376-4b9a-80ed-2dca21ac2a5d req-ed408035-1aec-4fac-8888-c68d6948527d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0801487
Jun 01 12:36:01.115208 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bde88bc7-b376-4b9a-80ed-2dca21ac2a5d req-136ce3f4-cfe9-4d31-bd82-8a4213151e37 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392859
Jun 01 12:36:02.311960 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-395a9707-b824-4a4c-841b-b82a0c8881cb req-e68c986b-8cdf-4778-9887-b1885681f5d4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:02.313424 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-395a9707-b824-4a4c-841b-b82a0c8881cb req-e68c986b-8cdf-4778-9887-b1885681f5d4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0919993
Jun 01 12:36:02.357964 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-395a9707-b824-4a4c-841b-b82a0c8881cb req-d5c3eff4-a11c-4262-aea3-68262eee58f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384853
Jun 01 12:36:03.539652 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c9dd56-8da8-4ee7-ba99-4ae72b130f5b req-ed4b5fb4-d8be-4924-b609-0bba10f9959d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:03.541146 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-70c9dd56-8da8-4ee7-ba99-4ae72b130f5b req-ed4b5fb4-d8be-4924-b609-0bba10f9959d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0782120
Jun 01 12:36:03.589136 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-70c9dd56-8da8-4ee7-ba99-4ae72b130f5b req-2e195ea5-8843-479d-96ba-179372055950 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422919
Jun 01 12:36:04.774218 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-627eb8e3-8b44-40b9-a683-24f34cc9cf2b req-eb57d025-c514-4d1d-9fb0-9b3f69898dda tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:04.775649 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-627eb8e3-8b44-40b9-a683-24f34cc9cf2b req-eb57d025-c514-4d1d-9fb0-9b3f69898dda tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0786095
Jun 01 12:36:04.819217 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-627eb8e3-8b44-40b9-a683-24f34cc9cf2b req-33f9838c-d4b1-4bde-822b-c7b3bfd4461e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380142
Jun 01 12:36:05.396447 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9fe16d-e9c1-46af-bb95-833ee9dbc1e2 req-84431f67-05ed-48df-914d-b3e8249bdf3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:05.397910 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6c9fe16d-e9c1-46af-bb95-833ee9dbc1e2 req-84431f67-05ed-48df-914d-b3e8249bdf3f service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 1098 time: 0.0696652
Jun 01 12:36:05.440480 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6c9fe16d-e9c1-46af-bb95-833ee9dbc1e2 req-ae95af49-84b0-41c8-91a9-4598d4ac0431 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0357747
Jun 01 12:36:06.034854 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9a7253-c895-47f1-8d27-2361b6e51f38 req-86482ff5-2bbe-48cc-b163-f2c48659c478 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:06.038069 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca9a7253-c895-47f1-8d27-2361b6e51f38 req-86482ff5-2bbe-48cc-b163-f2c48659c478 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1138709
Jun 01 12:36:06.104917 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca9a7253-c895-47f1-8d27-2361b6e51f38 req-71ec9f20-5aa2-4a0b-87f9-8f97782837a7 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0601699
Jun 01 12:36:07.315499 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce0675b-cd93-4b74-8cb0-c017d87f7cdf req-b8a48113-71fc-445c-aa58-0c114446a430 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:07.317552 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0ce0675b-cd93-4b74-8cb0-c017d87f7cdf req-b8a48113-71fc-445c-aa58-0c114446a430 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1003709
Jun 01 12:36:07.363799 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0ce0675b-cd93-4b74-8cb0-c017d87f7cdf req-1da7e298-0265-4824-a4f2-8e967e111e49 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405877
Jun 01 12:36:07.424243 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 57982) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:07.553380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:07.574026 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:07.580836 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Usage tracker for resource:security_group_rule and tenant:613f53c99f6a4cee811ab73512cfe5fb is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:07.584180 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:07.591348 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:07.601713 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7e476b-4ea1-4c06-a23d-6da109f98398 req-74c92773-0c49-406d-ba58-cdcbd03fddeb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:07.603154 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-af7e476b-4ea1-4c06-a23d-6da109f98398 req-74c92773-0c49-406d-ba58-cdcbd03fddeb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1312811
Jun 01 12:36:07.667748 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-af7e476b-4ea1-4c06-a23d-6da109f98398 req-16517a54-cc6a-4e8e-ac75-f73c867bda81 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0576010
Jun 01 12:36:07.731257 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:07.736423 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:07.750719 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:07.789717 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=613f53c99f6a4cee811ab73512cfe5fb&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3617868
Jun 01 12:36:07.790357 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 57994) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:07.791790 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d7836d8-0ac3-4d74-80ce-2a9f298bec05,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:07.794915 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:07.853867 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:07.883653 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:07.937460 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:07.942192 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-49328328-7e24-41c8-a3f4-3d37f1ae688b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:07.955780 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d7836d8-0ac3-4d74-80ce-2a9f298bec05,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:07.958353 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:07.965757 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:07.969352 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7d7836d8-0ac3-4d74-80ce-2a9f298bec05 HTTP/1.1" status: 204  len: 168 time: 0.1761205
Jun 01 12:36:08.278122 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58008) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:08.296201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:08.311220 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:08.315066 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Usage tracker for resource:security_group_rule and tenant:a2d983a6c3cf4ff6b22e5e2e1eb6a727 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:08.318299 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:08.324011 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:08.413144 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:08.416898 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:08.423583 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-25bb57d4-da7c-4035-92c1-a7f981982254 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:08.466346 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=a2d983a6c3cf4ff6b22e5e2e1eb6a727&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1871924
Jun 01 12:36:08.467202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7714d39e-8784-4ce8-8c95-d1a8f8407ced,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:08.469096 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58014) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:08.470080 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:08.527097 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:08.553932 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:08.606038 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:08.609512 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ff228f00-5b5e-4fea-9d64-73c9e62d6e98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:08.621230 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7714d39e-8784-4ce8-8c95-d1a8f8407ced,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:08.623938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:08.631289 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:08.632367 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7714d39e-8784-4ce8-8c95-d1a8f8407ced HTTP/1.1" status: 204  len: 168 time: 0.1616614
Jun 01 12:36:09.843986 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2b92f1a8-8899-444a-8fd4-a90b57057bda None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:11.900755 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-d5c439f2-2600-4ac8-a0c1-0dbf46fa8a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:11.903065 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-d5c439f2-2600-4ac8-a0c1-0dbf46fa8a19 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.1464581
Jun 01 12:36:11.981259 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b966593-bccd-4246-86e4-9583b49c1eb7 req-935cc245-9ecf-407a-bb9a-7c48157c2b8d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:11.986259 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4b966593-bccd-4246-86e4-9583b49c1eb7 req-935cc245-9ecf-407a-bb9a-7c48157c2b8d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1776881
Jun 01 12:36:12.086121 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:12.199628 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4b966593-bccd-4246-86e4-9583b49c1eb7 req-46fbf74d-d990-473b-9ae4-12a1ce4e6d86 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2054307
Jun 01 12:36:12.208532 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-4f209cf4-264e-47c3-b56f-0b894f0897bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:12.220707 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-4f209cf4-264e-47c3-b56f-0b894f0897bc service neutron] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 920 time: 0.3076837
Jun 01 12:36:12.340591 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:12.365122 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-f4f19651-c355-42d8-aced-90c90df125ba service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 200  len: 217 time: 0.1335986
Jun 01 12:36:12.431225 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-35968536-2071-42d5-9df7-2a900724f076 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:12.432953 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-35968536-2071-42d5-9df7-2a900724f076 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.0605340
Jun 01 12:36:12.487543 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-b37f0104-f371-45fe-bbf5-a16bbc137b2e service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0472093
Jun 01 12:36:12.564552 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58166) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:12.652653 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-48ea902d-2960-4239-b43c-18581499f4b2 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1574185
Jun 01 12:36:12.672775 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-818675fa-88e2-499c-96b1-6b706adec8a1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:12.764832 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:12.789692 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:12.794016 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Usage tracker for resource:security_group_rule and tenant:39f076515546498293a746fa0a3b575f is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:12.798411 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:12.808229 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:12.826032 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3afc6a22-84b6-44f7-8fef-1fdcebd8dc28 req-6e81e384-6338-484e-85d7-7e13cffb5485 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1528852
Jun 01 12:36:12.931526 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:12.935042 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:12.943782 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-93a74829-7499-4eac-8fd8-5c34ff63970a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:12.984469 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=39f076515546498293a746fa0a3b575f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4179106
Jun 01 12:36:12.985341 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eec5c70a-2824-4c1e-9990-fefd8f39db2d,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:12.987162 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58184) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:12.988995 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:13.058400 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7949c58a-3041-4ef5-8f16-f1f5c032d61d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.086881 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7949c58a-3041-4ef5-8f16-f1f5c032d61d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.145597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7949c58a-3041-4ef5-8f16-f1f5c032d61d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.149266 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-49734d34-4f52-4a9a-afe4-ad9d833e4bc9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:13.162555 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7949c58a-3041-4ef5-8f16-f1f5c032d61d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eec5c70a-2824-4c1e-9990-fefd8f39db2d,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:13.166373 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7949c58a-3041-4ef5-8f16-f1f5c032d61d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:13.177582 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7949c58a-3041-4ef5-8f16-f1f5c032d61d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.177582 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7949c58a-3041-4ef5-8f16-f1f5c032d61d admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/eec5c70a-2824-4c1e-9990-fefd8f39db2d HTTP/1.1" status: 204  len: 168 time: 0.1838267
Jun 01 12:36:13.411532 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19054aff-2fda-4d6d-97d7-a2d86dae2b5c req-9ac710d1-c2be-46c0-8916-f92bc030df04 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:13.418935 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-19054aff-2fda-4d6d-97d7-a2d86dae2b5c req-9ac710d1-c2be-46c0-8916-f92bc030df04 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0964367
Jun 01 12:36:13.448655 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58208) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:13.471144 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-19054aff-2fda-4d6d-97d7-a2d86dae2b5c req-ca7b4852-422e-4c2c-b82e-df6d666e80de tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0510459
Jun 01 12:36:13.643039 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.658726 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:13.663321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Usage tracker for resource:security_group_rule and tenant:200ec1ef30c24961ae2c1fd654c88eb2 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:13.666321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:13.672173 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:13.772766 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.777493 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.784799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9f38b4a4-b36f-420c-ae0e-42a5c268c727 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:13.830165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1802c44-5831-4629-993b-2c6a6a977a81,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:13.844602 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=200ec1ef30c24961ae2c1fd654c88eb2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3848422
Jun 01 12:36:13.844602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b9a29779-96c2-4a0b-84af-702ef5c981f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:13.845382 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58226) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:13.873402 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.901272 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.930083 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.993150 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:13.996881 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8e54e672-40f2-43bc-9e0d-34d1baa6ab1b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:14.009511 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1802c44-5831-4629-993b-2c6a6a977a81,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:14.011949 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:14.024865 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:14.026379 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/f1802c44-5831-4629-993b-2c6a6a977a81 HTTP/1.1" status: 204  len: 168 time: 0.1877627
Jun 01 12:36:14.661012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383b25aa-228b-49ae-ad73-ba7387d046c0 req-35ea7105-7560-4163-bdab-e5dcfc2f338c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:14.662472 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-383b25aa-228b-49ae-ad73-ba7387d046c0 req-35ea7105-7560-4163-bdab-e5dcfc2f338c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0805488
Jun 01 12:36:14.708748 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-383b25aa-228b-49ae-ad73-ba7387d046c0 req-058b9d1e-64ca-46fe-b414-31a6156f364f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0404437
Jun 01 12:36:14.779986 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58272) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:14.892723 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1154672317-network', 'tenant_id': 'de15817fec1344958f88c8a9b4ad3a81'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:14.898047 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:14.901932 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Usage tracker for resource:network and tenant:de15817fec1344958f88c8a9b4ad3a81 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:14.904689 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:14.911139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:14.921465 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Made reservation on behalf of de15817fec1344958f88c8a9b4ad3a81 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:14.923840 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:14.935756 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:14.959464 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:14.963247 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Usage tracker for resource:security_group_rule and tenant:de15817fec1344958f88c8a9b4ad3a81 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:14.966321 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:14.972022 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:15.059271 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.062940 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.065658 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b8e014d8-1d54-4add-828e-9c0766fb1bc4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:15.094733 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] vlan segment allocate from pool success with {'vlan_id': 775, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:36:15.099776 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=618a82d3-59d4-4787-b8c4-7a2c63649640,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:15.103260 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:15.107550 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.107550 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Added segment 1743f99e-0bfd-4a13-a9a5-3c94f99e75ec of type vlan for network ad7e28fd-84b8-40b7-949c-94a41a55b4ce
Jun 01 12:36:15.133276 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.160752 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.162035 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:15.162593 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.167026 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e91d910b-ff54-4ae4-b162-6cb363206ef6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:15.260232 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.4791305
Jun 01 12:36:15.263209 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58282) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:15.268981 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Request body: {'subnet': {'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1154672317-subnet', 'tenant_id': 'de15817fec1344958f88c8a9b4ad3a81', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:15.269429 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Pushing event updated for resources: {'Network': ['ID=ad7e28fd-84b8-40b7-949c-94a41a55b4ce,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:15.273565 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:15.276753 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.277104 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.277350 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Usage tracker for resource:subnet and tenant:de15817fec1344958f88c8a9b4ad3a81 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:15.277461 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.277761 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.278091 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.278420 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.278745 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.279069 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.279395 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.279716 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.280034 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.280229 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:15.280335 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:15.283678 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:15.286465 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:15.290748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network ad7e28fd-84b8-40b7-949c-94a41a55b4ce details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:36:15.297342 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Made reservation on behalf of de15817fec1344958f88c8a9b4ad3a81 for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:15.299738 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2345690'] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.395790 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.681591 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2610733', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2345676'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.685965 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:15.759385 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0c11cd35-b97b-4949-aaa4-6eb3505216f7,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:15.763838 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:15.767903 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Checking segment: {'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:15.768247 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Network hostable DHCP agents. Network: ad7e28fd-84b8-40b7-949c-94a41a55b4ce, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:36:15.788624 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Network ad7e28fd-84b8-40b7-949c-94a41a55b4ce is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:36:15.799123 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, ad7e28fd-84b8-40b7-949c-94a41a55b4ce) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:15.807826 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:15.808445 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:15.809197 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20e408ce-bf5d-4d08-9632-f3d31cf432a6 None None] Network ad7e28fd-84b8-40b7-949c-94a41a55b4ce requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:36:15.849111 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.5847073
Jun 01 12:36:15.945955 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddb63ea-dfd2-43ba-8446-658cf9b0831b req-2168e6c0-c84c-4488-93f2-a551999da41e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:15.947560 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-dddb63ea-dfd2-43ba-8446-658cf9b0831b req-2168e6c0-c84c-4488-93f2-a551999da41e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1111803
Jun 01 12:36:16.013649 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-dddb63ea-dfd2-43ba-8446-658cf9b0831b req-672d9d71-3b69-4673-93ea-4df45b897368 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0550733
Jun 01 12:36:16.018315 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb93b597-1298-436d-a383-fcce261a82d5 None None] Network ad7e28fd-84b8-40b7-949c-94a41a55b4ce requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:36:17.204999 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742d42f5-c399-490a-bb5b-852b116e9b09 req-2e6b2ef3-5746-4b09-8295-555cb027c0ca tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:17.206448 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-742d42f5-c399-490a-bb5b-852b116e9b09 req-2e6b2ef3-5746-4b09-8295-555cb027c0ca tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0897028
Jun 01 12:36:17.249961 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-742d42f5-c399-490a-bb5b-852b116e9b09 req-953bb3af-22db-4cb0-a98e-bf01128d6f2e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373704
Jun 01 12:36:18.441737 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-618683cb-1a66-4271-9607-5b9328befcc8 req-dd2e1481-d9f5-4492-80fc-d8a298aa6ac3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:18.443215 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-618683cb-1a66-4271-9607-5b9328befcc8 req-dd2e1481-d9f5-4492-80fc-d8a298aa6ac3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0796709
Jun 01 12:36:18.490261 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-618683cb-1a66-4271-9607-5b9328befcc8 req-1ce5604a-b38b-42ea-8b12-0a42dc66fae2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414422
Jun 01 12:36:19.670756 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab49438-9dac-4f07-a2bd-7100a38afd04 req-e231fe46-a480-46c9-81e6-5707b8cdcb3f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:19.672195 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1ab49438-9dac-4f07-a2bd-7100a38afd04 req-e231fe46-a480-46c9-81e6-5707b8cdcb3f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0783069
Jun 01 12:36:19.716926 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1ab49438-9dac-4f07-a2bd-7100a38afd04 req-c15076ec-f8a5-4117-9825-489d206c11e6 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385437
Jun 01 12:36:19.872223 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:36:20.930178 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82934fca-8eb7-4c1a-891e-59d2207b2c79 req-f15d463d-750e-4adc-8a55-c3829f28be06 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:20.931757 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-82934fca-8eb7-4c1a-891e-59d2207b2c79 req-f15d463d-750e-4adc-8a55-c3829f28be06 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0996594
Jun 01 12:36:20.982992 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-82934fca-8eb7-4c1a-891e-59d2207b2c79 req-0a71cb4b-26a1-4c64-a001-11f50b8d368d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447783
Jun 01 12:36:21.236043 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-79bae52d-3cb5-4774-8ab9-b3f27af8e4b9 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:21.236771 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-79bae52d-3cb5-4774-8ab9-b3f27af8e4b9 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Synchronizing usage tracker for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:network {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:36:21.257324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-79bae52d-3cb5-4774-8ab9-b3f27af8e4b9 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Unset dirty status for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:network {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:36:21.263542 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-79bae52d-3cb5-4774-8ab9-b3f27af8e4b9 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/networks?id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce HTTP/1.1" status: 200  len: 809 time: 0.1857152
Jun 01 12:36:21.277675 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-ded74353-eea6-4451-9b2d-386a7fa4b407 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/quotas/de15817fec1344958f88c8a9b4ad3a81 HTTP/1.1" status: 200  len: 375 time: 0.0131488
Jun 01 12:36:21.331075 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-56119890-5ec2-4580-b069-fd39ae7f0279 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=de15817fec1344958f88c8a9b4ad3a81&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0479941
Jun 01 12:36:21.472661 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-d264d9bd-0bfb-4783-9b0b-439a7a1d94ec service neutron] 10.222.0.81 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1340590
Jun 01 12:36:21.627897 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-9e9d2ada-c0a0-42ab-ab56-bbe3e38d5b62 service neutron] 10.222.0.81 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1487601
Jun 01 12:36:21.775221 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58430) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:21.847026 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8e02ad34-f8a6-4ff3-b872-d9ebd2bee48e req-c8e0a021-f46c-40a2-86d3-ea089432c595 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.0551553
Jun 01 12:36:22.033343 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:22.051431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:22.055950 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Usage tracker for resource:security_group_rule and tenant:ce4805229994480992892261af15695f is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:22.059071 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:22.067209 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:22.189849 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4591f6b-22db-43bd-8f5c-2db578c073c0 req-2523043a-b42f-41dd-a4ac-8d5d018032fb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:22.191492 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e4591f6b-22db-43bd-8f5c-2db578c073c0 req-2523043a-b42f-41dd-a4ac-8d5d018032fb tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0932481
Jun 01 12:36:22.225387 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:22.231137 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:22.247082 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-da642ea6-4530-499e-9382-a6bae5891a0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:22.294495 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e4591f6b-22db-43bd-8f5c-2db578c073c0 req-9d0b8e17-0868-4255-90bf-debe28948af2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0971043
Jun 01 12:36:22.319211 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ce4805229994480992892261af15695f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5427094
Jun 01 12:36:22.320613 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2be70cac-f363-46a4-97b0-b06bfe891cc6,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:22.321635 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58448) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:22.334033 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.334614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.335201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.335776 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.336356 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.336971 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.337544 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.338106 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.338686 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.339256 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.339840 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.340408 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:22.346661 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:22.380951 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:22.406820 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:22.459421 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:22.463030 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-136c1c30-b21b-43e1-9eb6-f19a61a6e2f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:22.476699 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2be70cac-f363-46a4-97b0-b06bfe891cc6,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:22.479662 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:22.481667 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:22.482774 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/2be70cac-f363-46a4-97b0-b06bfe891cc6 HTTP/1.1" status: 204  len: 168 time: 0.1601884
Jun 01 12:36:23.004896 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f890d92f-36b1-40a9-bf6e-7892e37d1bcf req-51243a32-493f-45a4-8d46-5bd10ef6c6af tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.0457428
Jun 01 12:36:23.480506 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d142b07d-3f8a-48b1-9cb2-711417e765d0 req-48bd4e85-547a-4a73-b4d4-f12bd45d86ee tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:23.482141 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d142b07d-3f8a-48b1-9cb2-711417e765d0 req-48bd4e85-547a-4a73-b4d4-f12bd45d86ee tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0805328
Jun 01 12:36:23.529996 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d142b07d-3f8a-48b1-9cb2-711417e765d0 req-45256484-4078-4fec-8489-bad4437c3d98 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419428
Jun 01 12:36:24.153436 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e2daa246-63f0-4c71-b3ec-54ceed7ceaaa req-1b434af1-8b6b-4c09-81cf-a9fa82b05571 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.0443959
Jun 01 12:36:24.718552 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a00555-bf54-40d7-8c8b-3d87ab7438c5 req-f26f8ac9-9584-4abc-8046-4bb352875971 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:24.719989 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f1a00555-bf54-40d7-8c8b-3d87ab7438c5 req-f26f8ac9-9584-4abc-8046-4bb352875971 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0794570
Jun 01 12:36:24.766575 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f1a00555-bf54-40d7-8c8b-3d87ab7438c5 req-8002fdd9-b319-4b65-b863-d1419554fdd1 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405643
Jun 01 12:36:25.301765 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6838cd8a-69d9-4ba2-a304-5f60961a52c6 req-c860f10d-d4df-420e-bd05-036e50f96028 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.0418837
Jun 01 12:36:25.963900 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2e4f794-c7f6-469a-ab2f-3d0a6a43c3d2 req-ae97ab21-2dea-4908-aee1-307b006f4b45 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:25.965383 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b2e4f794-c7f6-469a-ab2f-3d0a6a43c3d2 req-ae97ab21-2dea-4908-aee1-307b006f4b45 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0832715
Jun 01 12:36:26.011275 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b2e4f794-c7f6-469a-ab2f-3d0a6a43c3d2 req-0d19ca89-d0ac-48f8-852d-5c5f688a4c3c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400851
Jun 01 12:36:26.579614 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-dbbf88ee-780f-4df6-b5bc-cb38ebc128f6 req-37349a66-ced3-4f00-882c-5d4664b23b73 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.0413396
Jun 01 12:36:27.269068 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f2a830-0fd7-4630-9048-234490d06684 req-564e3db3-e103-450c-b2cf-f1b76046953f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:27.270493 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57f2a830-0fd7-4630-9048-234490d06684 req-564e3db3-e103-450c-b2cf-f1b76046953f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1525590
Jun 01 12:36:27.313681 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57f2a830-0fd7-4630-9048-234490d06684 req-3f737685-7222-4545-ac1f-05a9b0f0827f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0374434
Jun 01 12:36:27.727439 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1df193ed-83d8-44ad-8000-90403aa90143 req-d2dfb660-e657-4a10-aeea-8801c4a8d328 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.0417492
Jun 01 12:36:28.421592 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-afa4aca7-034f-48ee-933d-ac70b3d705e7 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:28.423176 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-afa4aca7-034f-48ee-933d-ac70b3d705e7 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "GET /v2.0/networks?id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce HTTP/1.1" status: 200  len: 809 time: 0.1722670
Jun 01 12:36:28.473167 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Request body: {'port': {'device_id': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce', 'admin_state_up': True, 'tenant_id': 'de15817fec1344958f88c8a9b4ad3a81'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:28.627999 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce06363c-7198-4ef5-a9ec-bd7ef0663aad req-ea17aa68-6579-4784-a5c8-64cdb382ec6c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:28.630066 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ce06363c-7198-4ef5-a9ec-bd7ef0663aad req-ea17aa68-6579-4784-a5c8-64cdb382ec6c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2060056
Jun 01 12:36:28.637108 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:28.653162 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Usage tracker for resource:port and tenant:de15817fec1344958f88c8a9b4ad3a81 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:28.658346 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:28.666163 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:28.689541 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ce06363c-7198-4ef5-a9ec-bd7ef0663aad req-dc5bed08-1259-4bb6-81fa-9f4133ae68ce tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0533965
Jun 01 12:36:28.690552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Made reservation on behalf of de15817fec1344958f88c8a9b4ad3a81 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:28.694307 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:28.861714 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Allocated IP 172.20.0.4 (ad7e28fd-84b8-40b7-949c-94a41a55b4ce/0c11cd35-b97b-4949-aaa4-6eb3505216f7/9171502c-c57b-482f-be77-430ef46d374c) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:28.889102 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4407ecd0-517c-4ff5-91bc-bc4af12f1fb0 req-74c311e5-205c-463e-9d31-22852d46bfaf tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.0506146
Jun 01 12:36:29.081838 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:29.119887 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:29.141453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-62a0b2c0-0f98-4c20-9241-b87c0aa44497 tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:29.233214 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Network ad7e28fd-84b8-40b7-949c-94a41a55b4ce is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:29.233920 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Pushing event updated for resources: {'Port': ['ID=9171502c-c57b-482f-be77-430ef46d374c,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:29.236361 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:29.245355 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:29.272621 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:29.316321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:29.316971 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:29.353388 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8905485
Jun 01 12:36:29.366331 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Request body: {'port': {'device_id': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:29.548707 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:29.933337 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15bb5fc3-5bcb-42f9-98e6-735b3b54bf6a req-9f44e090-311c-43a5-80d6-c99154aaa4a5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:29.935933 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-15bb5fc3-5bcb-42f9-98e6-735b3b54bf6a req-9f44e090-311c-43a5-80d6-c99154aaa4a5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1279521
Jun 01 12:36:29.989023 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9171502c-c57b-482f-be77-430ef46d374c {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:36:29.990928 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-15bb5fc3-5bcb-42f9-98e6-735b3b54bf6a req-a4e23743-999b-4858-817a-5a5d14ea8998 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485704
Jun 01 12:36:30.006223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:30.028338 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Transition to ACTIVE for port object 9171502c-c57b-482f-be77-430ef46d374c will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:30.031945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:30.037409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:30.351739 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Pushing event updated for resources: {'Port': ['ID=9171502c-c57b-482f-be77-430ef46d374c,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:30.359527 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.322s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:30.435224 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a3b8bb-34f2-4535-bbf1-84b84e14ac1c req-2cf5ba32-5aef-4901-a754-dec3aa555e60 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:30.435967 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-49a3b8bb-34f2-4535-bbf1-84b84e14ac1c req-2cf5ba32-5aef-4901-a754-dec3aa555e60 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Synchronizing usage tracker for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:36:30.461020 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Attempting to bind port 9171502c-c57b-482f-be77-430ef46d374c on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:30.461342 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Attempting to bind port 9171502c-c57b-482f-be77-430ef46d374c by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:30.461663 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Attempting to bind port 9171502c-c57b-482f-be77-430ef46d374c on network ad7e28fd-84b8-40b7-949c-94a41a55b4ce {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:30.471275 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Port 9171502c-c57b-482f-be77-430ef46d374c on network ad7e28fd-84b8-40b7-949c-94a41a55b4ce not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:36:30.471553 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Attempting to bind port 9171502c-c57b-482f-be77-430ef46d374c on network ad7e28fd-84b8-40b7-949c-94a41a55b4ce {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:30.475664 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-49a3b8bb-34f2-4535-bbf1-84b84e14ac1c req-2cf5ba32-5aef-4901-a754-dec3aa555e60 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Unset dirty status for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:36:30.476922 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-49a3b8bb-34f2-4535-bbf1-84b84e14ac1c req-2cf5ba32-5aef-4901-a754-dec3aa555e60 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 943 time: 0.3988659
Jun 01 12:36:30.479447 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:30.479794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Checking segment: {'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:30.480148 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Bound using segment: {'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:30.480603 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Bound port: 9171502c-c57b-482f-be77-430ef46d374c, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:30.480947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:30.584186 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-49a3b8bb-34f2-4535-bbf1-84b84e14ac1c req-f4a98663-4865-44c1-8f14-19081b833823 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0917876
Jun 01 12:36:30.618453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] For port 9171502c-c57b-482f-be77-430ef46d374c, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:30.621847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] For port 9171502c-c57b-482f-be77-430ef46d374c, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9171502c-c57b-482f-be77-430ef46d374c,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:30.627306 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:30.633105 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:30.691686 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:30.692550 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:30.693658 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] 10.222.0.95 "PUT /v2.0/ports/9171502c-c57b-482f-be77-430ef46d374c HTTP/1.1" status: 200  len: 1093 time: 1.3314984
Jun 01 12:36:30.694126 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'tag': '9171502c-c57b-482f-be77-430ef46d374c'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:36:30.696461 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48361470-8234-4f14-a3fd-7d0048349fd7" -d '{"events": [{"name": "network-changed", "server_uuid": "ec3af58e-30b7-493b-8223-ea4ae8f0776b", "tag": "9171502c-c57b-482f-be77-430ef46d374c"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:36:30.721562 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Pushing event updated for resources: {'Port': ['ID=9171502c-c57b-482f-be77-430ef46d374c,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:30.724963 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:30.787309 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:36:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3641bf6-3a52-490d-ac13-148a9abc2e7d x-openstack-request-id: req-c3641bf6-3a52-490d-ac13-148a9abc2e7d {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:36:30.787621 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ec3af58e-30b7-493b-8223-ea4ae8f0776b", "tag": "9171502c-c57b-482f-be77-430ef46d374c", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:36:30.787891 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-c3641bf6-3a52-490d-ac13-148a9abc2e7d {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:36:30.788292 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'tag': '9171502c-c57b-482f-be77-430ef46d374c', 'status': 'completed', 'code': 200}
Jun 01 12:36:30.887078 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93571e01-8187-4179-a9ff-e899a715d5ce req-0c9304fd-c6f4-4732-acef-0a04c2e0b90d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:30.888532 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-93571e01-8187-4179-a9ff-e899a715d5ce req-0c9304fd-c6f4-4732-acef-0a04c2e0b90d service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.1379895
Jun 01 12:36:30.891170 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-931a5415-02e1-4329-bc45-5dbefe92677f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:30.892638 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-931a5415-02e1-4329-bc45-5dbefe92677f service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=de15817fec1344958f88c8a9b4ad3a81&device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 1096 time: 0.1116529
Jun 01 12:36:30.980842 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-9a74b3ea-6789-4755-9b85-e192155f26c1 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=9171502c-c57b-482f-be77-430ef46d374c HTTP/1.1" status: 200  len: 217 time: 0.0658004
Jun 01 12:36:31.036602 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-93571e01-8187-4179-a9ff-e899a715d5ce req-d522f4dd-db5e-4b71-a72d-07991e768286 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1345940
Jun 01 12:36:31.051234 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-0905cf9c-b23b-45b1-9d57-220b56b64071 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:31.053787 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-0905cf9c-b23b-45b1-9d57-220b56b64071 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=0c11cd35-b97b-4949-aaa4-6eb3505216f7 HTTP/1.1" status: 200  len: 849 time: 0.0643718
Jun 01 12:36:31.180933 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-880d5535-0a59-4079-9511-da940876c72e service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0875168
Jun 01 12:36:31.322158 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5901b820-17fa-44e5-9575-a8857a38a8ae req-65980999-73a8-49ea-af8f-50c9aa77b992 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:31.329175 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5901b820-17fa-44e5-9575-a8857a38a8ae req-65980999-73a8-49ea-af8f-50c9aa77b992 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1988268
Jun 01 12:36:31.366815 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-235b7414-4791-4326-b68a-4e887d1baa10 service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1778195
Jun 01 12:36:31.421167 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5901b820-17fa-44e5-9575-a8857a38a8ae req-5a1e72b3-7209-412a-b596-7b5b17f51257 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0910349
Jun 01 12:36:31.547841 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b4d2a31e-6f4e-483e-95a2-6398dbd75fb2 req-08df3329-0a03-43ca-ac11-5345ebe12248 service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1653309
Jun 01 12:36:31.698181 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-c6f715e1-91cb-4f67-81d0-8c233f53b23a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:31.700275 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-c6f715e1-91cb-4f67-81d0-8c233f53b23a service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=de15817fec1344958f88c8a9b4ad3a81&device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 1096 time: 0.0936558
Jun 01 12:36:31.859935 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58694) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:32.014479 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-07ea20ff-7868-4e29-b50a-9e0f2db1f506 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:32.016468 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-07ea20ff-7868-4e29-b50a-9e0f2db1f506 service neutron] 10.222.0.95 "GET /v2.0/networks?id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce HTTP/1.1" status: 200  len: 910 time: 0.3054407
Jun 01 12:36:32.026749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f8f57f-3059-44cf-9f3e-acba69eaa49f req-e561f447-6fad-4062-a8d3-05f069a1bf94 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:32.035066 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f2f8f57f-3059-44cf-9f3e-acba69eaa49f req-e561f447-6fad-4062-a8d3-05f069a1bf94 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 943 time: 0.2141519
Jun 01 12:36:32.092811 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.111575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:32.116276 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Usage tracker for resource:security_group_rule and tenant:bd3106bf6f464a678b5cf75c44f86da7 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:32.120053 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:32.126291 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:32.128947 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-8023e6dd-88be-4093-b5c4-5aa525fd35f7 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=9171502c-c57b-482f-be77-430ef46d374c HTTP/1.1" status: 200  len: 217 time: 0.0913439
Jun 01 12:36:32.186109 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f2f8f57f-3059-44cf-9f3e-acba69eaa49f req-e6a6738d-1956-4c7f-bead-a880b7d59f11 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1498761
Jun 01 12:36:32.213015 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-96509ad5-9f89-4c36-a663-6593a417a808 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:32.214510 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-96509ad5-9f89-4c36-a663-6593a417a808 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=0c11cd35-b97b-4949-aaa4-6eb3505216f7 HTTP/1.1" status: 200  len: 849 time: 0.0703943
Jun 01 12:36:32.220873 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.226393 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.234933 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7ddc932e-b9a7-4afe-92c5-57af44f8b9c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:32.275245 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=bd3106bf6f464a678b5cf75c44f86da7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4134924
Jun 01 12:36:32.275992 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d845d2b-58a2-43e1-94d5-429afcb616a3,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:32.279260 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58708) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:32.282395 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:32.343890 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.363482 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-8a92150d-d0d7-4d1a-acca-c228855f39ed service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1380291
Jun 01 12:36:32.373567 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.429112 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.434246 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:32.445660 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d845d2b-58a2-43e1-94d5-429afcb616a3,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:32.448232 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:32.456923 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.461534 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/1d845d2b-58a2-43e1-94d5-429afcb616a3 HTTP/1.1" status: 204  len: 168 time: 0.1812193
Jun 01 12:36:32.518730 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-3fed2272-4af4-47bc-86f8-39984a93cd80 service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1462975
Jun 01 12:36:32.646305 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3077a8c3-ae51-4cdb-8197-e503a5d42178 req-7d1ff099-4fe6-4f18-bdec-827b7b119a80 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:32.647987 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3077a8c3-ae51-4cdb-8197-e503a5d42178 req-7d1ff099-4fe6-4f18-bdec-827b7b119a80 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1009970
Jun 01 12:36:32.665158 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48361470-8234-4f14-a3fd-7d0048349fd7 req-67ea3a42-d271-4c68-acba-bc82d2a777b1 service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1373010
Jun 01 12:36:32.696886 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3077a8c3-ae51-4cdb-8197-e503a5d42178 req-5f9097d6-d795-476f-b5e0-565c5f1a5e45 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416532
Jun 01 12:36:32.781600 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58722) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:32.799698 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.814151 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:32.818067 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Usage tracker for resource:security_group_rule and tenant:ff0e2d27ca864ac09cdb33d0e5f684f4 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:32.820881 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:32.831743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:32.929501 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.934661 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:32.944154 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9292deba-a22c-4cb1-8e7d-25211c6f9d03 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:32.986637 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ff0e2d27ca864ac09cdb33d0e5f684f4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2036622
Jun 01 12:36:32.989558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58734) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:33.000226 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9bda352-5ee6-4466-87bd-49397f12df12,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:33.004353 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:33.121862 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:33.153480 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:33.169138 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c03ff09b-bcc8-4315-8558-79e1ded81a27 req-5c2f7c0a-8603-427d-ae18-c175f22cdf2a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:33.177042 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c03ff09b-bcc8-4315-8558-79e1ded81a27 req-5c2f7c0a-8603-427d-ae18-c175f22cdf2a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0961134
Jun 01 12:36:33.207709 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-f0eff8c1-e6a5-471a-9d73-b07b81bce02e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:33.211635 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-f0eff8c1-e6a5-471a-9d73-b07b81bce02e service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.1658206
Jun 01 12:36:33.232855 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c03ff09b-bcc8-4315-8558-79e1ded81a27 req-db33bbfe-3cd8-4a2b-8b49-75c26a63b08c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0546298
Jun 01 12:36:33.334854 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:33.343814 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6973f149-49aa-44ad-aa44-4a5b3f649e20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:33.408500 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9bda352-5ee6-4466-87bd-49397f12df12,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:33.417582 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:33.430166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:33.430905 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/f9bda352-5ee6-4466-87bd-49397f12df12 HTTP/1.1" status: 204  len: 168 time: 0.4403660
Jun 01 12:36:33.488603 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-af835ae6-0c62-4eaf-935c-6614ea308fb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:33.490100 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-af835ae6-0c62-4eaf-935c-6614ea308fb9 service neutron] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 920 time: 0.2730870
Jun 01 12:36:33.563504 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8192d795-7860-49b5-b6ea-72ba4be4b121 req-2be908eb-2883-42da-8db9-6827f3621cb5 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:33.565081 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8192d795-7860-49b5-b6ea-72ba4be4b121 req-2be908eb-2883-42da-8db9-6827f3621cb5 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 943 time: 0.2147102
Jun 01 12:36:33.568571 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58756) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:33.574365 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-ab4c3d01-4a68-4d01-84d7-7726f6505d63 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 200  len: 217 time: 0.0753837
Jun 01 12:36:33.677402 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-00acca7b-1b6f-43ba-8fd7-d75be579530c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:33.678914 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-00acca7b-1b6f-43ba-8fd7-d75be579530c service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.0972857
Jun 01 12:36:33.683748 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8192d795-7860-49b5-b6ea-72ba4be4b121 req-fef6b3d5-29c7-450b-afce-60b15391daed tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689194
Jun 01 12:36:33.735791 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-692a9f69-1beb-4c1b-b868-6e36126dd7a4 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0499423
Jun 01 12:36:33.874844 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:33.890099 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:33.894729 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Usage tracker for resource:security_group_rule and tenant:8b46e4b177d144eba97ab28c39de4cff is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:33.897716 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:33.903493 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:33.931670 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-83389905-0086-4cdd-a81e-85c442500d9f service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1877286
Jun 01 12:36:34.002819 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:34.009365 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:34.019490 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7b178cf6-34e0-45c9-8e03-7d73426816c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:34.062478 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=764da916-45d3-4fac-a3ce-f362a694d95a,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:34.066286 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:34.071942 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=8b46e4b177d144eba97ab28c39de4cff&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5024879
Jun 01 12:36:34.072370 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58778) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:34.079584 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e75518d9-6060-44af-bdcb-1cb81e95239d req-dcd8cb0f-666e-4f8a-a74a-28f9bb1913f8 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1411080
Jun 01 12:36:34.140938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:34.167992 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:34.230371 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:34.235198 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e5758bc5-7a71-4d95-bbee-55d9f610fac2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:34.247781 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=764da916-45d3-4fac-a3ce-f362a694d95a,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:34.275450 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:34.278597 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:34.279551 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/764da916-45d3-4fac-a3ce-f362a694d95a HTTP/1.1" status: 204  len: 168 time: 0.2062562
Jun 01 12:36:34.475944 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c54290e-f869-4a9e-a979-c389346e74d9 req-de1787ed-0691-4326-9801-0449a9b3f02e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:34.485322 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5c54290e-f869-4a9e-a979-c389346e74d9 req-de1787ed-0691-4326-9801-0449a9b3f02e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1162679
Jun 01 12:36:34.540233 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5c54290e-f869-4a9e-a979-c389346e74d9 req-364f4f0b-f9fd-4e1b-abaf-bd45a87afbb3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0538778
Jun 01 12:36:34.733982 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9171502c-c57b-482f-be77-430ef46d374c details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:36:34.878611 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 9171502c-c57b-482f-be77-430ef46d374c, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9171502c-c57b-482f-be77-430ef46d374c,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:34.892543 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '9171502c-c57b-482f-be77-430ef46d374c', 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce', 'port_id': '9171502c-c57b-482f-be77-430ef46d374c', 'mac_address': 'fa:16:3e:fd:85:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 775, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0c11cd35-b97b-4949-aaa4-6eb3505216f7', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:36:34.963670 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:34.980319 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447802fd-37f1-44b3-9b78-761969561c65 req-5280e1c9-890f-4e35-9e17-9c1e052abc3e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:34.983299 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9171502c-c57b-482f-be77-430ef46d374c {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:36:34.986121 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-447802fd-37f1-44b3-9b78-761969561c65 req-5280e1c9-890f-4e35-9e17-9c1e052abc3e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 943 time: 0.1620181
Jun 01 12:36:35.000558 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 9171502c-c57b-482f-be77-430ef46d374c, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9171502c-c57b-482f-be77-430ef46d374c,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:35.005505 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.007398 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:35.032897 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58824) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:35.054391 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-447802fd-37f1-44b3-9b78-761969561c65 req-49e72cf0-1faa-41f7-abc1-c46dbfeb8f34 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Synchronizing usage tracker for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:36:35.085367 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=9171502c-c57b-482f-be77-430ef46d374c,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:35.095231 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.095837 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.096325 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.097645 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.098137 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.098799 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.099283 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.099751 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.100856 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.101341 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.101973 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.102277 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-447802fd-37f1-44b3-9b78-761969561c65 req-49e72cf0-1faa-41f7-abc1-c46dbfeb8f34 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Unset dirty status for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:36:35.102608 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:35.103509 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-447802fd-37f1-44b3-9b78-761969561c65 req-49e72cf0-1faa-41f7-abc1-c46dbfeb8f34 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1110442
Jun 01 12:36:35.108863 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:35.287361 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['9171502c-c57b-482f-be77-430ef46d374c'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:36:35.337475 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.360618 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:35.367477 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Usage tracker for resource:security_group_rule and tenant:33f794ddc38548ebaefa37f1c0fd2cdc is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:35.370450 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:35.377042 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:35.474030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.481976 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.501574 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f2854877-db5b-474a-977e-ba85982faa71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:35.545278 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=33f794ddc38548ebaefa37f1c0fd2cdc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5113094
Jun 01 12:36:35.546893 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0412716-5d78-44d1-adc6-669f14cc9041,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:35.547967 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58850) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:35.560187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:35.650524 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.681247 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.692552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58862) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:35.800771 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.806648 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-00204bc0-db1c-46d0-ae24-d17790cbc9c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:35.831619 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0412716-5d78-44d1-adc6-669f14cc9041,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:35.842987 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:35.844873 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:35.846140 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/e0412716-5d78-44d1-adc6-669f14cc9041 HTTP/1.1" status: 204  len: 168 time: 0.2968116
Jun 01 12:36:35.898953 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b41bcec2-f26a-413e-9ad7-b8ed2f9f0e86 req-55376de0-2508-43e7-a4bb-6de7b41e95e0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:35.901016 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b41bcec2-f26a-413e-9ad7-b8ed2f9f0e86 req-55376de0-2508-43e7-a4bb-6de7b41e95e0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1565690
Jun 01 12:36:35.992746 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b41bcec2-f26a-413e-9ad7-b8ed2f9f0e86 req-880a3d37-8a6d-4d80-a3a1-500a75dd49ff tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0815775
Jun 01 12:36:36.025883 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1536690532-network', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:36.033521 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:36.040121 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Usage tracker for resource:network and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:36.044771 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:36.053142 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:36.086063 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Made reservation on behalf of 892af7572bdb454483d1279dcfc9ccb0 for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:36.089968 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.107035 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.157446 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:36.175816 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:36.186788 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:36.203808 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:36.328890 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.391102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.395865 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9e3766d9-d122-4172-a775-92480741378a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:36.443765 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] vlan segment allocate from pool success with {'vlan_id': 759, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:36:36.453069 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a37cef80-dc2a-4855-9bba-1ba61f1520a2,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:36.461066 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:36.468928 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.469334 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Added segment 12681f3e-56a4-4c14-a93e-9cd2b361c70d of type vlan for network 42f63911-56d5-4572-8431-a99e560ca482
Jun 01 12:36:36.491689 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918530ea-9a50-4e80-8eac-9590d6777e95 req-e36017e7-11ed-49d0-9b30-a1658c336fd3 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:36.492386 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58890) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:36.493348 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-918530ea-9a50-4e80-8eac-9590d6777e95 req-e36017e7-11ed-49d0-9b30-a1658c336fd3 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 944 time: 0.1602783
Jun 01 12:36:36.519500 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.530968 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.537629 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:36.558114 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Usage tracker for resource:security_group_rule and tenant:336a3b64c51249d9a2d589db4f218a0a is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:36.581411 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.586639 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:36.587223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.587460 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:36.601691 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:36.602872 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:36.731136 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9171502c-c57b-482f-be77-430ef46d374c up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:36.739164 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-918530ea-9a50-4e80-8eac-9590d6777e95 req-a5796dd1-9618-41fb-a9b3-83dad10319ed tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2336817
Jun 01 12:36:36.835995 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.846045 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.872704 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-99bf4ef4-5075-4281-a853-586ca89704bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:36.877823 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 1.1841252
Jun 01 12:36:36.878685 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Pushing event updated for resources: {'Network': ['ID=42f63911-56d5-4572-8431-a99e560ca482,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:36.880895 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 58908) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:36.890334 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:36.892120 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 42f63911-56d5-4572-8431-a99e560ca482 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:36:36.894224 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Request body: {'subnet': {'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1536690532-subnet', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:36.898801 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:36.902807 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Usage tracker for resource:subnet and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:36.905817 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:36.913691 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:36.922826 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=336a3b64c51249d9a2d589db4f218a0a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4296613
Jun 01 12:36:36.926137 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58912) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:36.930961 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Made reservation on behalf of 892af7572bdb454483d1279dcfc9ccb0 for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:36.933790 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2345690'] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:36.993962 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=559de9e4-7d67-4366-ac3c-983bffc78674,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:37.008675 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:37.067248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.118645 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 9171502c-c57b-482f-be77-430ef46d374c completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:37.121719 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.139260 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 9171502c-c57b-482f-be77-430ef46d374c triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:37.139632 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.275035 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.314098 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 9171502c-c57b-482f-be77-430ef46d374c, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9171502c-c57b-482f-be77-430ef46d374c,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:37.315717 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9171502c-c57b-482f-be77-430ef46d374c'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:36:37.318324 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43203a7c-8b3d-4da6-92b1-193da689ab1f" -d '{"events": [{"server_uuid": "ec3af58e-30b7-493b-8223-ea4ae8f0776b", "name": "network-vif-plugged", "status": "completed", "tag": "9171502c-c57b-482f-be77-430ef46d374c"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:36:37.325262 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.329564 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:37.356991 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693f6dde-5653-4fa7-afc5-6158fca3840c req-044502cf-c102-47f3-83dc-39f786f67af7 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:37.358564 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-693f6dde-5653-4fa7-afc5-6158fca3840c req-044502cf-c102-47f3-83dc-39f786f67af7 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1898675
Jun 01 12:36:37.359706 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.364925 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0d2b503e-e8a4-445c-9fee-38ff0f6b6072 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:37.383597 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=559de9e4-7d67-4366-ac3c-983bffc78674,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:37.418955 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:36:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-62b375ab-5071-46b1-9a09-e6e52e157073 x-openstack-request-id: req-62b375ab-5071-46b1-9a09-e6e52e157073 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:36:37.419572 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec3af58e-30b7-493b-8223-ea4ae8f0776b", "name": "network-vif-plugged", "status": "completed", "tag": "9171502c-c57b-482f-be77-430ef46d374c", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:36:37.420110 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-62b375ab-5071-46b1-9a09-e6e52e157073 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:36:37.420216 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:37.420807 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9171502c-c57b-482f-be77-430ef46d374c', 'code': 200}
Jun 01 12:36:37.424205 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.425545 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/559de9e4-7d67-4366-ac3c-983bffc78674 HTTP/1.1" status: 204  len: 168 time: 0.4980361
Jun 01 12:36:37.436569 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-693f6dde-5653-4fa7-afc5-6158fca3840c req-8d41b160-140c-4f07-a4bc-a2dd1415aec1 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0587299
Jun 01 12:36:37.445734 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=9171502c-c57b-482f-be77-430ef46d374c,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:37.457888 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:37.512352 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2610733', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2345676'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.517320 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:37.607076 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=056def2a-a8b2-4665-b4ba-cc9e031e8b58,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:37.615798 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:37.616529 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Checking segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:37.617040 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Network hostable DHCP agents. Network: 42f63911-56d5-4572-8431-a99e560ca482, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:36:37.639273 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Network 42f63911-56d5-4572-8431-a99e560ca482 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:36:37.652129 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 42f63911-56d5-4572-8431-a99e560ca482) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:37.663047 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-085f2d24-bfe5-455c-b275-86561be77aa0 None None] Network 42f63911-56d5-4572-8431-a99e560ca482 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:36:37.668483 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:37.669118 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.698930 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 848 time: 0.8112350
Jun 01 12:36:37.700440 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 58940) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:37.705847 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:37.715155 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:37.725615 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Usage tracker for resource:router and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:37.729233 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:37.742881 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:37.771226 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.772790 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.793763 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:37.993510 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-42f63911-56d5-4572-8431-a99e560ca482', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:36:37.995168 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:38.035706 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6de9899-19c1-4f36-a1fc-28240fc4d6f7 req-5ae0fcf5-f7c5-4f69-90f0-8c3eb47c3cbb tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:38.045563 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e6de9899-19c1-4f36-a1fc-28240fc4d6f7 req-5ae0fcf5-f7c5-4f69-90f0-8c3eb47c3cbb tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 945 time: 0.1509819
Jun 01 12:36:38.154109 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e6de9899-19c1-4f36-a1fc-28240fc4d6f7 req-80779fb2-c583-487f-8c5c-8a1ec2833075 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1012931
Jun 01 12:36:38.337525 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:38.352241 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Allocated IP 172.20.0.2 (42f63911-56d5-4572-8431-a99e560ca482/056def2a-a8b2-4665-b4ba-cc9e031e8b58/3346551a-7373-43a5-847b-45403c6dbdb6) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:38.644694 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:38.659506 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Transition to ACTIVE for port object 3346551a-7373-43a5-847b-45403c6dbdb6 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:38.682395 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Transition to ACTIVE for port object 3346551a-7373-43a5-847b-45403c6dbdb6 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:38.689352 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:38.695764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:38.770475 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Network 42f63911-56d5-4572-8431-a99e560ca482 is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:38.773270 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:38.773927 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:38.778274 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:38.787716 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Pushing event updated for resources: {'Port': ['ID=3346551a-7373-43a5-847b-45403c6dbdb6,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:38.829833 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:38.842393 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:38.893917 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Attempting to bind port 3346551a-7373-43a5-847b-45403c6dbdb6 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:38.894298 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Attempting to bind port 3346551a-7373-43a5-847b-45403c6dbdb6 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:38.894690 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Attempting to bind port 3346551a-7373-43a5-847b-45403c6dbdb6 on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:38.900505 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:38.901042 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Checking segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:38.901449 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:38.901848 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Bound using segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:38.902330 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Bound port: 3346551a-7373-43a5-847b-45403c6dbdb6, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:38.902700 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:39.002102 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Allocated IP 172.27.3.36 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/459514ae-5687-4f89-b04f-45365372c314) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:39.003612 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] For port 3346551a-7373-43a5-847b-45403c6dbdb6, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:39.006797 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] For port 3346551a-7373-43a5-847b-45403c6dbdb6, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=3346551a-7373-43a5-847b-45403c6dbdb6,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:39.011328 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:39.018931 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:39.126053 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Pushing event updated for resources: {'Port': ['ID=3346551a-7373-43a5-847b-45403c6dbdb6,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:39.135310 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:39.181555 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:39.229142 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:39.234966 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:39.330451 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:39.333598 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:39.338074 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:39.372259 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8bb287-6951-4a88-a59a-bbc84395ba3c req-c94a08f7-2a3f-4eb5-9954-1162538f19ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:39.387807 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d8bb287-6951-4a88-a59a-bbc84395ba3c req-c94a08f7-2a3f-4eb5-9954-1162538f19ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 945 time: 0.1107411
Jun 01 12:36:39.409760 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Pushing event updated for resources: {'Port': ['ID=459514ae-5687-4f89-b04f-45365372c314,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:39.417470 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:39.461507 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d8bb287-6951-4a88-a59a-bbc84395ba3c req-bbf217e3-2b82-45a0-90e0-bcec560c9508 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0635703
Jun 01 12:36:39.850001 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-50c8770b-333a-41cf-8dfc-91492a02ff81 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:39.887059 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:40.238211 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aeff6211-a46a-496a-b37b-68e305488c99 None None] Network 42f63911-56d5-4572-8431-a99e560ca482 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:36:40.318323 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:40.421511 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-b9d9a32a-650a-4474-8ed2-17610d54a198 None None] Provisioning for port 3346551a-7373-43a5-847b-45403c6dbdb6 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:40.582488 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-8e9de2b0-12e9-4c86-9d75-f32121358327 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.2792523
Jun 01 12:36:40.612866 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd965d9-a381-4255-a354-c777e06ebca6 req-c147e12f-602a-4e54-a5c9-422533f34b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:40.618362 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fd965d9-a381-4255-a354-c777e06ebca6 req-c147e12f-602a-4e54-a5c9-422533f34b10 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 1098 time: 0.1814046
Jun 01 12:36:40.697072 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Router 1a362d20-82d6-490f-bb46-3dede6760253 is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91978) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:36:40.807514 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fd965d9-a381-4255-a354-c777e06ebca6 req-b4c288d4-455d-4718-83aa-ed8cb73d46a8 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0862930
Jun 01 12:36:40.842701 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-69fa2c67-d292-4b74-8f81-f413483ef8fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:40.844340 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-69fa2c67-d292-4b74-8f81-f413483ef8fe service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 1098 time: 0.2250285
Jun 01 12:36:40.868457 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-182887ea-1627-4a2c-a09c-390a8a6c8c2d req-c3a9e459-6987-4480-a214-02d174e4a916 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:40.877410 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-182887ea-1627-4a2c-a09c-390a8a6c8c2d req-c3a9e459-6987-4480-a214-02d174e4a916 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 945 time: 0.2542570
Jun 01 12:36:40.921422 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:36:40.934243 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:36:40.952346 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3346551a-7373-43a5-847b-45403c6dbdb6 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:40.957732 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:40.958475 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c820>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:40.961886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:40.963091 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.2616539
Jun 01 12:36:40.965908 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59028) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:41.037805 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-182887ea-1627-4a2c-a09c-390a8a6c8c2d req-7626150a-8409-4b15-bf6e-196e3a2169c5 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1587532
Jun 01 12:36:41.094437 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 3346551a-7373-43a5-847b-45403c6dbdb6 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:41.100224 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-4ca7f9df-23c4-47cd-a03b-dbab64a23274 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:41.101963 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-4ca7f9df-23c4-47cd-a03b-dbab64a23274 service neutron] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 920 time: 0.2102778
Jun 01 12:36:41.104718 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 3346551a-7373-43a5-847b-45403c6dbdb6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:41.105840 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:41.152259 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:36:41.218654 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-ede70574-3d1f-424d-93bc-cdcdc5107004 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249 HTTP/1.1" status: 200  len: 217 time: 0.1092520
Jun 01 12:36:41.344176 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:41.356393 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-199ce933-3828-46da-a655-3b166d657ece service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:41.359264 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-199ce933-3828-46da-a655-3b166d657ece service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.1256511
Jun 01 12:36:41.409824 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 3346551a-7373-43a5-847b-45403c6dbdb6, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=3346551a-7373-43a5-847b-45403c6dbdb6,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:41.417231 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:41.419068 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-f45fec70-aff2-4289-bfd6-16ed8c0c901e service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0519180
Jun 01 12:36:41.419317 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:41.481576 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c820>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:39Z', 'revision_number': 3, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:41.488483 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:36:41.489401 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Updating router 1a362d20-82d6-490f-bb46-3dede6760253 port 459514ae-5687-4f89-b04f-45365372c314 binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:36:41.492000 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=3346551a-7373-43a5-847b-45403c6dbdb6,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:41.495830 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:41.548236 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:41.945340 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-3d1dc607-766b-4627-a9ef-b1d7fc8b0feb service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5013318
Jun 01 12:36:42.090109 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.129949 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.144049 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Transition to ACTIVE for port object 459514ae-5687-4f89-b04f-45365372c314 will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:42.155837 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.168120 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-f4c1f5d4-2aa1-4a62-9636-110a37430640 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:42.193255 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.241287 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ff18b17-7c57-4614-a0b0-9c96200e90b7 req-1e090e90-e706-4d7c-a70f-ff793a9c6f87 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2802422
Jun 01 12:36:42.251411 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Attempting to bind port 459514ae-5687-4f89-b04f-45365372c314 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:42.251941 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Attempting to bind port 459514ae-5687-4f89-b04f-45365372c314 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:42.253365 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Attempting to bind port 459514ae-5687-4f89-b04f-45365372c314 on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:42.263116 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:42.263600 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:42.264162 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.264778 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:42.265362 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Bound port: 459514ae-5687-4f89-b04f-45365372c314, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:42.265813 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.295823 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Pushing event updated for resources: {'Port': ['ID=459514ae-5687-4f89-b04f-45365372c314,revision_number=2']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:42.321475 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.322129 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.322566 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.322988 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.323438 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.323926 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.324388 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.325081 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.325542 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.326287 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.326484 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.326902 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:36:42.332291 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:42.340208 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.364477 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] For port 459514ae-5687-4f89-b04f-45365372c314, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:42.368250 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] For port 459514ae-5687-4f89-b04f-45365372c314, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=459514ae-5687-4f89-b04f-45365372c314,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:42.376709 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.387032 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-f4c1f5d4-2aa1-4a62-9636-110a37430640 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:42.511328 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8bcf93d-86d5-49e1-93e7-1a1814fc4065 req-a18e9825-ef63-4890-9cfb-aa2ecb7a4952 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:42.512975 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:42.513641 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c820>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:42.515927 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e8bcf93d-86d5-49e1-93e7-1a1814fc4065 req-a18e9825-ef63-4890-9cfb-aa2ecb7a4952 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.3323624
Jun 01 12:36:42.564892 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d9d52bd-8e68-4ca4-a004-f8d07744c001 req-7293b7a0-15d0-4ce9-9082-d28585aee0a8 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:42.572482 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5d9d52bd-8e68-4ca4-a004-f8d07744c001 req-7293b7a0-15d0-4ce9-9082-d28585aee0a8 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 945 time: 0.2390635
Jun 01 12:36:42.580115 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Pushing event updated for resources: {'Port': ['ID=459514ae-5687-4f89-b04f-45365372c314,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:42.597588 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:42.623893 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5d9d52bd-8e68-4ca4-a004-f8d07744c001 req-2e86cd19-362a-4bc6-9019-8e495fca0852 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485191
Jun 01 12:36:42.672678 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-86f7346c-b253-4161-a125-49685af97ad4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:42.690493 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e8bcf93d-86d5-49e1-93e7-1a1814fc4065 req-5be5688a-9d0d-4a12-881f-65230d2350a1 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1632693
Jun 01 12:36:42.749239 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Allocated IP 172.20.0.1 (42f63911-56d5-4572-8431-a99e560ca482/056def2a-a8b2-4665-b4ba-cc9e031e8b58/0feddf7d-6197-457c-9357-35720610c9f9) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:42.806164 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:36:42.913948 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3346551a-7373-43a5-847b-45403c6dbdb6 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:42.978672 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.001038 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.provisioning_blocks [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Transition to ACTIVE for port object 0feddf7d-6197-457c-9357-35720610c9f9 will not be triggered until provisioned by entity DHCP. {{(pid=91978) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:43.018733 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 3346551a-7373-43a5-847b-45403c6dbdb6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:43.019108 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.036454 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.043669 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:43.129779 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Network 42f63911-56d5-4572-8431-a99e560ca482 is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:43.132719 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:43.136388 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:43.187489 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Pushing event updated for resources: {'Port': ['ID=0feddf7d-6197-457c-9357-35720610c9f9,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:43.194075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:43.195011 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.249346 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c820>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:39Z', 'revision_number': 3, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:43.257855 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cfad27d-0b07-4f2d-ba16-dbef2a703dd9 None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:39Z', 'revision_number': 3, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:36:43.433705 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-7b9c3c5b-b6f7-4bbd-99a7-b0c4bb8f7904 None None] Provisioning for port 0feddf7d-6197-457c-9357-35720610c9f9 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:43.442512 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-7b9c3c5b-b6f7-4bbd-99a7-b0c4bb8f7904 None None] Provisioning complete for port 0feddf7d-6197-457c-9357-35720610c9f9 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:43.442800 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7b9c3c5b-b6f7-4bbd-99a7-b0c4bb8f7904 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.449240 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.546596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-7b9c3c5b-b6f7-4bbd-99a7-b0c4bb8f7904 None None] Port 0feddf7d-6197-457c-9357-35720610c9f9 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:36:43.829803 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.836817 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.854736 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:43.869602 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:43.966269 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Pushing event updated for resources: {'Port': ['ID=0feddf7d-6197-457c-9357-35720610c9f9,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:43.972970 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:43.986701 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:44.298768 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Network 42f63911-56d5-4572-8431-a99e560ca482 is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:44.301212 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:44.690937 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-7b07b1af-1d39-4c72-a908-daa7292c2c00 None None] Provisioning complete for port 0feddf7d-6197-457c-9357-35720610c9f9 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:44.692558 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7b07b1af-1d39-4c72-a908-daa7292c2c00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:44.741666 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:36:44.846620 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-7b07b1af-1d39-4c72-a908-daa7292c2c00 None None] Port 0feddf7d-6197-457c-9357-35720610c9f9 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:36:44.906902 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 459514ae-5687-4f89-b04f-45365372c314 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:44.938940 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf43dc89-8433-4a19-b6c0-764e5e749378 req-d57f5dfd-9597-41b0-bbcf-4d25bb2a37c4 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:44.947574 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bf43dc89-8433-4a19-b6c0-764e5e749378 req-d57f5dfd-9597-41b0-bbcf-4d25bb2a37c4 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 945 time: 0.1510675
Jun 01 12:36:45.015791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:36:45.031492 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] 10.222.0.81 "PUT /v2.0/routers/1a362d20-82d6-490f-bb46-3dede6760253/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.0645664
Jun 01 12:36:45.037100 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bf43dc89-8433-4a19-b6c0-764e5e749378 req-96c337f6-0946-44c2-9c2a-3b5590a5077f tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0885460
Jun 01 12:36:45.076404 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 459514ae-5687-4f89-b04f-45365372c314 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:45.087190 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 459514ae-5687-4f89-b04f-45365372c314 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:45.087567 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.286888 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.310574 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 459514ae-5687-4f89-b04f-45365372c314, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=459514ae-5687-4f89-b04f-45365372c314,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:45.315647 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.318729 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:45.399997 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.407780 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=459514ae-5687-4f89-b04f-45365372c314,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:45.417155 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:45.429970 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:36:45.439571 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:45.440894 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a251757c0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:45.684314 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:36:45.762151 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59158) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:45.769047 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-784118365-network', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:45.774827 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:45.780099 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Usage tracker for resource:network and tenant:bcdfacaebc2c46cb92fbb72bc2498b24 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:45.783075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:45.789379 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:45.813223 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Made reservation on behalf of bcdfacaebc2c46cb92fbb72bc2498b24 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:45.817124 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.842081 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.862253 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:45.867957 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Usage tracker for resource:security_group_rule and tenant:bcdfacaebc2c46cb92fbb72bc2498b24 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:45.873216 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:45.880027 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:45.967876 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.972128 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:45.976479 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7e9fa11c-9330-4e60-9017-f021ca84ecd5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:46.007673 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] vlan segment allocate from pool success with {'vlan_id': 774, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:36:46.022295 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af18be6d-b488-4598-908f-bae6ccb6e4e6,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:46.026465 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:46.029939 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.030819 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Added segment f845736a-7d73-4a5c-9544-aa3e3e70137c of type vlan for network 12269b2c-6505-4483-b715-3d56d83902f2
Jun 01 12:36:46.031927 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a251757c0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 2, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:46.037912 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:36:46.038295 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Updating router 1a362d20-82d6-490f-bb46-3dede6760253 port 0feddf7d-6197-457c-9357-35720610c9f9 binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:36:46.062713 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.110865 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.137075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.140220 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:46.140847 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.162234 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:46.336367 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Pushing event updated for resources: {'Network': ['ID=12269b2c-6505-4483-b715-3d56d83902f2,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:46.339642 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:46.342822 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.5795798
Jun 01 12:36:46.350916 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59172) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:46.358576 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Request body: {'subnet': {'network_id': '12269b2c-6505-4483-b715-3d56d83902f2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-784118365-subnet', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:46.367924 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:46.373318 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Usage tracker for resource:subnet and tenant:bcdfacaebc2c46cb92fbb72bc2498b24 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:46.377572 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:46.384484 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:46.400692 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Made reservation on behalf of bcdfacaebc2c46cb92fbb72bc2498b24 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:46.403704 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3089724'] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.435536 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-53e89f22-af21-438e-92f1-17883aedfae8 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:46.436875 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 12269b2c-6505-4483-b715-3d56d83902f2 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:36:46.438152 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-53e89f22-af21-438e-92f1-17883aedfae8 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 945 time: 0.1387832
Jun 01 12:36:46.444154 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d01539-bf99-4bfc-858c-20447fc69e8f req-c0b8c35d-f1c8-49dd-8741-7f15ecf23e57 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:46.450813 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-80d01539-bf99-4bfc-858c-20447fc69e8f req-c0b8c35d-f1c8-49dd-8741-7f15ecf23e57 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 945 time: 0.2633998
Jun 01 12:36:46.596595 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-80d01539-bf99-4bfc-858c-20447fc69e8f req-e93a444a-bffe-426b-aca5-51e5812d4a0d tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1378849
Jun 01 12:36:46.642380 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Deleting port 9171502c-c57b-482f-be77-430ef46d374c {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:36:46.642983 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.854003 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] For port 9171502c-c57b-482f-be77-430ef46d374c, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9171502c-c57b-482f-be77-430ef46d374c,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:46.854345 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.882528 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 459514ae-5687-4f89-b04f-45365372c314 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:46.935677 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.964093 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Transition to ACTIVE for port object 0feddf7d-6197-457c-9357-35720610c9f9 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:46.975330 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:46.986024 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:47.162358 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2584281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3089706'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.169404 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2b215030-6f4d-4dcf-8e9e-4cb09466b6f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:47.189979 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Calling delete_port for 9171502c-c57b-482f-be77-430ef46d374c owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:36:47.222988 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 459514ae-5687-4f89-b04f-45365372c314 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:47.223458 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.274935 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Checking segment: {'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:47.274935 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Network hostable DHCP agents. Network: 12269b2c-6505-4483-b715-3d56d83902f2, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:36:47.277777 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a630deea-a2cc-4a29-9c45-3180bc13da34,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:47.283101 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:47.310688 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Network 12269b2c-6505-4483-b715-3d56d83902f2 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:36:47.334468 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 12269b2c-6505-4483-b715-3d56d83902f2) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:47.343859 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf6d2e6-9d39-48c9-811f-687807979dd8 None None] Pushing event updated for resources: {'Port': ['ID=0feddf7d-6197-457c-9357-35720610c9f9,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:47.351879 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:47.352475 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.356310 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39ef4268-e231-489e-93cd-86b2a14ffe46 None None] Network 12269b2c-6505-4483-b715-3d56d83902f2 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:36:47.373844 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6bf6d2e6-9d39-48c9-811f-687807979dd8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.387s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:47.386201 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7eed5590-37d8-46c5-9c0b-f0cb7411e6f7 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.0341561
Jun 01 12:36:47.388259 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59198) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:47.398908 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:47.400526 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.411196 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:47.416166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:47.416851 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Usage tracker for resource:router and tenant:bcdfacaebc2c46cb92fbb72bc2498b24 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:47.421100 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:47.422036 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['9171502c-c57b-482f-be77-430ef46d374c'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:36:47.429642 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:47.444469 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.445999 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.486486 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.528092 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Attempting to bind port 0feddf7d-6197-457c-9357-35720610c9f9 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:47.528461 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Attempting to bind port 0feddf7d-6197-457c-9357-35720610c9f9 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:47.528847 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Attempting to bind port 0feddf7d-6197-457c-9357-35720610c9f9 on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:47.564542 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:47.565506 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Checking segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:47.565907 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.566301 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Bound using segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:47.566789 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Bound port: 0feddf7d-6197-457c-9357-35720610c9f9, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:47.567167 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.629102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Pushing event deleted for resources: {'Port': ['ID=9171502c-c57b-482f-be77-430ef46d374c,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:47.644093 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:47.724003 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] No DVR routers for this DVR port 9171502c-c57b-482f-be77-430ef46d374c on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:36:47.737510 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:47.744105 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'name': 'network-vif-deleted', 'tag': '9171502c-c57b-482f-be77-430ef46d374c'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:36:47.748591 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1db197e8-8604-411f-8337-e31e92f991f9" -d '{"events": [{"server_uuid": "ec3af58e-30b7-493b-8223-ea4ae8f0776b", "name": "network-vif-deleted", "tag": "9171502c-c57b-482f-be77-430ef46d374c"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:36:47.780423 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1a48265b-ba10-4b48-b15d-722c4cce12e5 req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "DELETE /v2.0/ports/9171502c-c57b-482f-be77-430ef46d374c HTTP/1.1" status: 204  len: 173 time: 1.3360324
Jun 01 12:36:47.937411 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-1787bf93-492f-4ad8-9c19-9bd1633f2b0c req-b4379228-2298-4800-8b7d-2f3cf64bbe67 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Synchronizing usage tracker for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:36:47.945151 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:36:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-88744ddb-09ef-4d7c-86c1-769799efbbf8 x-openstack-request-id: req-88744ddb-09ef-4d7c-86c1-769799efbbf8 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:36:47.947461 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec3af58e-30b7-493b-8223-ea4ae8f0776b", "name": "network-vif-deleted", "tag": "9171502c-c57b-482f-be77-430ef46d374c", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:36:47.947932 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-88744ddb-09ef-4d7c-86c1-769799efbbf8 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:36:47.948569 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec3af58e-30b7-493b-8223-ea4ae8f0776b', 'name': 'network-vif-deleted', 'tag': '9171502c-c57b-482f-be77-430ef46d374c', 'status': 'completed', 'code': 200}
Jun 01 12:36:47.981755 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-1787bf93-492f-4ad8-9c19-9bd1633f2b0c req-b4379228-2298-4800-8b7d-2f3cf64bbe67 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Unset dirty status for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:36:47.983578 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] For port 0feddf7d-6197-457c-9357-35720610c9f9, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:47.990685 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] For port 0feddf7d-6197-457c-9357-35720610c9f9, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=0feddf7d-6197-457c-9357-35720610c9f9,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:47.997106 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1787bf93-492f-4ad8-9c19-9bd1633f2b0c req-b4379228-2298-4800-8b7d-2f3cf64bbe67 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=ec3af58e-30b7-493b-8223-ea4ae8f0776b HTTP/1.1" status: 200  len: 210 time: 0.1461620
Jun 01 12:36:48.022693 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:48.032147 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:48.058177 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:48.093049 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-12269b2c-6505-4483-b715-3d56d83902f2', 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'fixed_ips': [{'subnet_id': 'a630deea-a2cc-4a29-9c45-3180bc13da34'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:36:48.093985 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:48.290346 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf6d2e6-9d39-48c9-811f-687807979dd8 None None] Pushing event updated for resources: {'Port': ['ID=0feddf7d-6197-457c-9357-35720610c9f9,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:48.309058 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6bf6d2e6-9d39-48c9-811f-687807979dd8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:48.343272 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:48.347601 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a251757c0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:48.487935 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Allocated IP 172.20.0.2 (12269b2c-6505-4483-b715-3d56d83902f2/a630deea-a2cc-4a29-9c45-3180bc13da34/28a4a744-87a4-4f89-859f-e79650acabd9) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:48.527991 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:48.575048 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:48.793828 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:36:48.811909 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Allocated IP 172.27.3.39 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/1c1de546-761e-443c-9484-ee6cb9694b62) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:49.008615 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:49.072161 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:49.079394 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:49.098139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:49.149186 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Transition to ACTIVE for port object 28a4a744-87a4-4f89-859f-e79650acabd9 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:49.208827 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Transition to ACTIVE for port object 28a4a744-87a4-4f89-859f-e79650acabd9 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:49.224691 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:49.227749 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:49.228188 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:49.230467 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:49.235656 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:49.309085 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Pushing event updated for resources: {'Port': ['ID=1c1de546-761e-443c-9484-ee6cb9694b62,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:49.333195 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:49.364827 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Network 12269b2c-6505-4483-b715-3d56d83902f2 is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:49.369515 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:49.375519 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:49.392237 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e7baba-e2d3-4ec7-a4d5-c0bea53556d6 req-cfe4c573-b32c-4c16-bc43-41957fad60ce tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:49.394986 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-73e7baba-e2d3-4ec7-a4d5-c0bea53556d6 req-cfe4c573-b32c-4c16-bc43-41957fad60ce tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1910710
Jun 01 12:36:49.400714 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Pushing event updated for resources: {'Port': ['ID=28a4a744-87a4-4f89-859f-e79650acabd9,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:49.409774 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:49.452408 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-73e7baba-e2d3-4ec7-a4d5-c0bea53556d6 req-b4506aa4-1543-4640-a98f-a51a65cd2b51 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0516877
Jun 01 12:36:49.567114 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Attempting to bind port 28a4a744-87a4-4f89-859f-e79650acabd9 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:49.567490 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Attempting to bind port 28a4a744-87a4-4f89-859f-e79650acabd9 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:49.567857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Attempting to bind port 28a4a744-87a4-4f89-859f-e79650acabd9 on network 12269b2c-6505-4483-b715-3d56d83902f2 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:49.576033 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:49.576407 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Checking segment: {'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:49.576885 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:49.577410 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Bound using segment: {'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:49.577885 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Bound port: 28a4a744-87a4-4f89-859f-e79650acabd9, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:49.578259 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:49.636270 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a251757c0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:47Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:49.657636 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4dae829-290e-471c-9bb7-345d64f30bbb None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:47Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:36:49.710193 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] For port 28a4a744-87a4-4f89-859f-e79650acabd9, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:49.732063 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] For port 28a4a744-87a4-4f89-859f-e79650acabd9, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=28a4a744-87a4-4f89-859f-e79650acabd9,segment=NetworkSegment(f845736a-7d73-4a5c-9544-aa3e3e70137c),segment_id=f845736a-7d73-4a5c-9544-aa3e3e70137c)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:49.747981 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:49.753913 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:49.812808 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-6fe461b6-e47f-4363-a280-144b80e4fe4e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:49.819652 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-6fe461b6-e47f-4363-a280-144b80e4fe4e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/networks?id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce HTTP/1.1" status: 200  len: 809 time: 0.2785170
Jun 01 12:36:49.863685 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Pushing event updated for resources: {'Port': ['ID=28a4a744-87a4-4f89-859f-e79650acabd9,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:49.872414 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:49.906369 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-c3399b75-7db2-43ce-a000-76bdae97e5fb tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/quotas/de15817fec1344958f88c8a9b4ad3a81 HTTP/1.1" status: 200  len: 375 time: 0.0857787
Jun 01 12:36:49.982355 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-eca7b51b-a0b1-485b-b314-99b5a155161c tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=de15817fec1344958f88c8a9b4ad3a81&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0749989
Jun 01 12:36:50.337384 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:50.523069 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-fbd15289-ef69-4352-bb6e-84f867fcdf1e service neutron] 10.222.0.81 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5302181
Jun 01 12:36:50.700368 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe77535-94c9-4bea-b8b4-5db3b78f8d8f req-4d77f10f-0a3d-4021-9008-98b0eddad487 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:50.702055 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-dbe77535-94c9-4bea-b8b4-5db3b78f8d8f req-4d77f10f-0a3d-4021-9008-98b0eddad487 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1243567
Jun 01 12:36:50.790872 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-dbe77535-94c9-4bea-b8b4-5db3b78f8d8f req-a6e8603e-6c5c-45ad-952b-5ed937b86339 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0718234
Jun 01 12:36:50.800403 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9171502c-c57b-482f-be77-430ef46d374c no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:36:50.907592 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 9171502c-c57b-482f-be77-430ef46d374c {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:36:50.907950 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9171502c-c57b-482f-be77-430ef46d374c not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:36:51.056128 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-41bcfac9-6b19-48ad-9dfa-6bed9e0b00db service neutron] 10.222.0.81 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5246601
Jun 01 12:36:51.059791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 28a4a744-87a4-4f89-859f-e79650acabd9 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:51.081183 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:51.185432 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 28a4a744-87a4-4f89-859f-e79650acabd9 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:51.193016 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0feddf7d-6197-457c-9357-35720610c9f9 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:51.379154 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 0feddf7d-6197-457c-9357-35720610c9f9 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:51.388299 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 0feddf7d-6197-457c-9357-35720610c9f9 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:51.389791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:51.391910 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59336) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:51.496748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-451aaa12-cb56-423e-9ddf-f05aecee3bad None None] Network 12269b2c-6505-4483-b715-3d56d83902f2 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:36:51.498979 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Router 18300301-a2ad-4993-90fe-7c3b01d4d555 is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91978) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:36:51.508488 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e33f2f3e-0360-4588-aef5-941e4812babf req-d2d94c9c-8d3b-4693-aa27-44d1ce37eb1d tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 210 time: 0.1512909
Jun 01 12:36:51.635851 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Provisioning for port 28a4a744-87a4-4f89-859f-e79650acabd9 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:51.662116 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Provisioning complete for port 28a4a744-87a4-4f89-859f-e79650acabd9 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:51.662496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:51.703464 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:51.727173 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:51.737987 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Usage tracker for resource:security_group_rule and tenant:c8052bba2d3e4822bec600ae3c6d1a42 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:51.744497 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:51.755566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:36:51.758443 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:51.774687 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Sync routers for ids ['18300301-a2ad-4993-90fe-7c3b01d4d555'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:36:51.785223 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Routers {'18300301-a2ad-4993-90fe-7c3b01d4d555'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:51.786118 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c5b0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['18300301-a2ad-4993-90fe-7c3b01d4d555'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:51.834878 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:51.836858 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 4.4464748
Jun 01 12:36:51.841186 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59352) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:52.022709 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.177004 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Set router 18300301-a2ad-4993-90fe-7c3b01d4d555 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:36:52.183113 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 0feddf7d-6197-457c-9357-35720610c9f9, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=0feddf7d-6197-457c-9357-35720610c9f9,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:52.194604 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.208045 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:52.284420 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.310425 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=0feddf7d-6197-457c-9357-35720610c9f9,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:52.318234 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:52.357712 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] For port 28a4a744-87a4-4f89-859f-e79650acabd9, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=28a4a744-87a4-4f89-859f-e79650acabd9,segment=NetworkSegment(f845736a-7d73-4a5c-9544-aa3e3e70137c),segment_id=f845736a-7d73-4a5c-9544-aa3e3e70137c)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:52.366407 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.370781 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:52.428699 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.512167 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Pushing event updated for resources: {'Port': ['ID=28a4a744-87a4-4f89-859f-e79650acabd9,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:52.516168 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:52.630030 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c5b0>, [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39'}], 'enable_snat': True}, 'gw_port_id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:36:49Z', 'revision_number': 3, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port': {'id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:5d:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:48Z', 'updated_at': '2021-06-01T12:36:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:52.634208 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Checking router: 18300301-a2ad-4993-90fe-7c3b01d4d555 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:36:52.634782 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Updating router 18300301-a2ad-4993-90fe-7c3b01d4d555 port 1c1de546-761e-443c-9484-ee6cb9694b62 binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:36:52.692472 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-08654246-9fb7-421d-b322-f28771ce9838 None None] Provisioning complete for port 28a4a744-87a4-4f89-859f-e79650acabd9 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:52.698619 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-08654246-9fb7-421d-b322-f28771ce9838 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.700635 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.701617 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3bd9f9f8-c91f-47a3-9d98-8ece3fd06c28 req-70d222d0-2fb6-4940-ad5d-1c96250e0ecf tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 210 time: 0.0544958
Jun 01 12:36:52.736963 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:52.749949 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-502de594-2d49-45be-8722-7b67ac44c633 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:52.820035 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c8052bba2d3e4822bec600ae3c6d1a42&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4263380
Jun 01 12:36:52.820914 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59366) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:52.914017 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e15eb7a-7488-432b-a792-05047dcc9caf,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:52.930704 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b738637b-a28b-4599-a869-71e3786b3f6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:52.957314 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 28a4a744-87a4-4f89-859f-e79650acabd9 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:53.032792 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 28a4a744-87a4-4f89-859f-e79650acabd9 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:53.033526 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.062908 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7827efaf-d15b-4cf4-9d88-b6783a15dfda req-c5fcd860-e262-4961-985a-e9a31bb8673c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:53.065578 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7827efaf-d15b-4cf4-9d88-b6783a15dfda req-c5fcd860-e262-4961-985a-e9a31bb8673c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.8427591
Jun 01 12:36:53.098898 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-aed70536-4cf2-4534-9f39-c8714b5efae6 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:53.100406 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-aed70536-4cf2-4534-9f39-c8714b5efae6 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "GET /v2.0/networks?id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce HTTP/1.1" status: 200  len: 809 time: 0.3489566
Jun 01 12:36:53.128235 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Request body: {'port': {'device_id': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce', 'admin_state_up': True, 'tenant_id': 'de15817fec1344958f88c8a9b4ad3a81'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:53.204263 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.222240 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0feddf7d-6197-457c-9357-35720610c9f9 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:53.224542 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7827efaf-d15b-4cf4-9d88-b6783a15dfda req-94ec0c78-13cd-4161-8afd-3c701c5a8404 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1216006
Jun 01 12:36:53.271549 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.350429 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 0feddf7d-6197-457c-9357-35720610c9f9 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:53.350809 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.357850 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.370706 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Transition to ACTIVE for port object 1c1de546-761e-443c-9484-ee6cb9694b62 will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:53.380756 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.387320 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:53.472752 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466f20bf-0be9-4ba4-a9e6-49cd83d33fda None None] Pushing event updated for resources: {'Port': ['ID=1c1de546-761e-443c-9484-ee6cb9694b62,revision_number=2']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:53.475651 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-466f20bf-0be9-4ba4-a9e6-49cd83d33fda None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:53.484973 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.499573 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Attempting to bind port 1c1de546-761e-443c-9484-ee6cb9694b62 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:53.499946 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Attempting to bind port 1c1de546-761e-443c-9484-ee6cb9694b62 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:53.501478 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Attempting to bind port 1c1de546-761e-443c-9484-ee6cb9694b62 on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:53.508547 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:53.508951 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:53.509348 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.509736 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:53.510197 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Bound port: 1c1de546-761e-443c-9484-ee6cb9694b62, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:53.510557 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.522001 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:53.532659 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:53.548795 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Made reservation on behalf of de15817fec1344958f88c8a9b4ad3a81 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:36:53.552437 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.599572 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] For port 1c1de546-761e-443c-9484-ee6cb9694b62, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:53.603416 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] For port 1c1de546-761e-443c-9484-ee6cb9694b62, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=1c1de546-761e-443c-9484-ee6cb9694b62,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:53.618815 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.629879 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:53.637185 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.656633 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:53.665633 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e15eb7a-7488-432b-a792-05047dcc9caf,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:53.671388 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:53.689907 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.691014 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/5e15eb7a-7488-432b-a792-05047dcc9caf HTTP/1.1" status: 204  len: 168 time: 0.7835221
Jun 01 12:36:53.757098 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Allocated IP 172.20.0.1 (12269b2c-6505-4483-b715-3d56d83902f2/a630deea-a2cc-4a29-9c45-3180bc13da34/db362eaa-5ce3-4b55-a834-f2a50ec38ae6) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:53.807454 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Routers {'18300301-a2ad-4993-90fe-7c3b01d4d555'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:53.808160 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c5b0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['18300301-a2ad-4993-90fe-7c3b01d4d555'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:53.844630 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Allocated IP 172.20.0.4 (ad7e28fd-84b8-40b7-949c-94a41a55b4ce/0c11cd35-b97b-4949-aaa4-6eb3505216f7/7310f663-89c8-4b45-b408-e61f219f9e2a) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:36:53.979963 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:53.995960 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466f20bf-0be9-4ba4-a9e6-49cd83d33fda None None] Pushing event updated for resources: {'Port': ['ID=1c1de546-761e-443c-9484-ee6cb9694b62,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:54.000272 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-466f20bf-0be9-4ba4-a9e6-49cd83d33fda None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.370s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:54.009203 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.provisioning_blocks [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Transition to ACTIVE for port object db362eaa-5ce3-4b55-a834-f2a50ec38ae6 will not be triggered until provisioned by entity DHCP. {{(pid=91978) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:54.011514 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-59002527-f6db-40f3-84ef-e93d3225eb3a req-6b98f50c-452e-4de5-be37-4496a9657384 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 210 time: 0.0748656
Jun 01 12:36:54.039833 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.047818 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-bee2e4b8-a214-4393-8b95-88cacb20fcf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:54.094566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59390) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:54.134162 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Network 12269b2c-6505-4483-b715-3d56d83902f2 is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:54.137354 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:54.153509 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:54.160288 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] Set router 18300301-a2ad-4993-90fe-7c3b01d4d555 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:36:54.228635 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.230924 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59396) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:54.241120 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.265912 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Pushing event updated for resources: {'Port': ['ID=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:54.274903 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:54.278542 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.281256 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.290834 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-084cb145-c6e2-443d-891e-96d6c14c7fcd tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:54.328283 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:54.335247 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Usage tracker for resource:security_group_rule and tenant:e7f567a824c647f9877dc5fff1e25f58 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:54.338352 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:54.347125 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:54.380325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Network ad7e28fd-84b8-40b7-949c-94a41a55b4ce is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:54.384301 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:54.387504 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:36:54.524006 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Pushing event updated for resources: {'Port': ['ID=7310f663-89c8-4b45-b408-e61f219f9e2a,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:54.534755 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:54.552463 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5402c43d-5593-4015-9ff3-e41247540642 None None] Provisioning for port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:54.561877 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5402c43d-5593-4015-9ff3-e41247540642 None None] Provisioning complete for port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:54.562103 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.563476 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5402c43d-5593-4015-9ff3-e41247540642 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.575831 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:54.576207 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.617031 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4964950
Jun 01 12:36:54.629962 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.631551 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Request body: {'port': {'device_id': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:54.668772 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b88c7202-096c-4c79-b81a-8285b7b000c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:54.677816 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-5402c43d-5593-4015-9ff3-e41247540642 None None] Port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:36:54.698346 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.707591 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2520c5b0>, [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39'}], 'enable_snat': True}, 'gw_port_id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:36:49Z', 'revision_number': 3, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port': {'id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:5d:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:48Z', 'updated_at': '2021-06-01T12:36:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:54.712949 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6f14fc-eca5-4ac4-a8eb-29f6764bb578 None None] The sync data for ids ['18300301-a2ad-4993-90fe-7c3b01d4d555'] in dv-cinder-793515-2-iscsi is: [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39'}], 'enable_snat': True}, 'gw_port_id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:36:49Z', 'revision_number': 3, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port': {'id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:5d:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:48Z', 'updated_at': '2021-06-01T12:36:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:36:54.750555 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50fbbed0-d012-4fe8-a315-d369753a2d1b,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:54.755184 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:54.761707 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:54.765028 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e7f567a824c647f9877dc5fff1e25f58&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5304086
Jun 01 12:36:54.767316 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Usage tracker for resource:security_group_rule and tenant:d05ed4a051524bc49a258455c0b6be57 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:54.768225 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59406) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:54.771238 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:54.780894 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.782309 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:54.845379 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0d6077-89bc-4295-9d51-e3e25b8bac93 req-a270fd28-695b-4fad-98d4-8aed0a0f4843 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:54.847462 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-aa0d6077-89bc-4295-9d51-e3e25b8bac93 req-a270fd28-695b-4fad-98d4-8aed0a0f4843 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.2824595
Jun 01 12:36:54.944120 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:54.945941 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.003039 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-aa0d6077-89bc-4295-9d51-e3e25b8bac93 req-f176da97-77c1-4598-863e-ac62cc9675ba tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1223552
Jun 01 12:36:55.048879 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.098409 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.115378 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.298377 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.303931 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bef1f790-669c-40c7-b7f3-5538e4998e40 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:55.327631 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50fbbed0-d012-4fe8-a315-d369753a2d1b,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:55.330839 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:55.343108 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-18dd7954-5349-4678-869b-402369c7b423 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:55.357485 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.361104 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/50fbbed0-d012-4fe8-a315-d369753a2d1b HTTP/1.1" status: 204  len: 168 time: 0.5895102
Jun 01 12:36:55.407217 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d05ed4a051524bc49a258455c0b6be57&name=default HTTP/1.1" status: 200  len: 2979 time: 1.3110366
Jun 01 12:36:55.418658 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660bd7c1-463e-4525-b1df-02a313b5f853 req-4e38b4b3-f823-4e91-adb2-15fc503837be tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:55.419557 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59414) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:55.419669 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-660bd7c1-463e-4525-b1df-02a313b5f853 req-4e38b4b3-f823-4e91-adb2-15fc503837be tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Synchronizing usage tracker for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:36:55.439100 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=994b879d-1876-4eea-8fc8-d557519028db,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:55.460103 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:55.460917 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7310f663-89c8-4b45-b408-e61f219f9e2a {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:36:55.467276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-660bd7c1-463e-4525-b1df-02a313b5f853 req-4e38b4b3-f823-4e91-adb2-15fc503837be tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Unset dirty status for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:36:55.468543 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-660bd7c1-463e-4525-b1df-02a313b5f853 req-4e38b4b3-f823-4e91-adb2-15fc503837be tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 931 time: 0.2920887
Jun 01 12:36:55.474227 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.524282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Transition to ACTIVE for port object 7310f663-89c8-4b45-b408-e61f219f9e2a will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:55.537987 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.549337 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:55.565491 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.598701 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.681857 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.687031 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.689057 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.695577 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-660bd7c1-463e-4525-b1df-02a313b5f853 req-e33b1854-8f7a-4179-b95f-68a6fdd6da64 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2176261
Jun 01 12:36:55.742944 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-4c0a6039-8ccf-432a-a6ff-acb528d38122 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:55.774621 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=994b879d-1876-4eea-8fc8-d557519028db,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:55.781457 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:55.794703 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.039s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:55.856267 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Pushing event updated for resources: {'Port': ['ID=7310f663-89c8-4b45-b408-e61f219f9e2a,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:55.889330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Pushing event updated for resources: {'Port': ['ID=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:55.891737 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.343s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:55.894360 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:55.897530 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.901082 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/994b879d-1876-4eea-8fc8-d557519028db HTTP/1.1" status: 204  len: 168 time: 0.4640484
Jun 01 12:36:55.904139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.927442 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59428) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:55.958258 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:55.986302 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:55.992787 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Usage tracker for resource:security_group_rule and tenant:a74a369e611a4f0bbec632c6291d75ee is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:55.995581 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Attempting to bind port 7310f663-89c8-4b45-b408-e61f219f9e2a on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:55.995904 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Attempting to bind port 7310f663-89c8-4b45-b408-e61f219f9e2a by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:55.996226 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Attempting to bind port 7310f663-89c8-4b45-b408-e61f219f9e2a on network ad7e28fd-84b8-40b7-949c-94a41a55b4ce {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:55.999745 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:56.006552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Port 7310f663-89c8-4b45-b408-e61f219f9e2a on network ad7e28fd-84b8-40b7-949c-94a41a55b4ce not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:36:56.006861 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Attempting to bind port 7310f663-89c8-4b45-b408-e61f219f9e2a on network ad7e28fd-84b8-40b7-949c-94a41a55b4ce {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:56.010304 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:56.014889 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:56.015214 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Checking segment: {'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:56.015589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Bound using segment: {'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:56.016014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Bound port: 7310f663-89c8-4b45-b408-e61f219f9e2a, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 775, 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:56.016350 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:56.077604 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Network 12269b2c-6505-4483-b715-3d56d83902f2 is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:36:56.078774 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:36:56.275934 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] For port 7310f663-89c8-4b45-b408-e61f219f9e2a, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:56.280279 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] For port 7310f663-89c8-4b45-b408-e61f219f9e2a, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=7310f663-89c8-4b45-b408-e61f219f9e2a,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:56.360199 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Router 18300301-a2ad-4993-90fe-7c3b01d4d555 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:36:56.368228 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:56.386642 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:56.471164 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-bc4e2662-868f-4a0e-9ad4-6ee2c6490414 None None] Provisioning complete for port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:56.472307 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-bc4e2662-868f-4a0e-9ad4-6ee2c6490414 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:56.519689 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:56.520373 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:56.523555 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] 10.222.0.95 "PUT /v2.0/ports/7310f663-89c8-4b45-b408-e61f219f9e2a HTTP/1.1" status: 200  len: 1093 time: 1.8973749
Jun 01 12:36:56.530074 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'tag': '7310f663-89c8-4b45-b408-e61f219f9e2a'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:36:56.532411 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8fff717a-eaed-407a-b55b-bbb79ced4d2d" -d '{"events": [{"name": "network-changed", "server_uuid": "cad7448c-1bae-4ddf-82aa-705653c7b1fe", "tag": "7310f663-89c8-4b45-b408-e61f219f9e2a"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:36:56.586823 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-bc4e2662-868f-4a0e-9ad4-6ee2c6490414 None None] Port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:36:56.605386 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59442) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:56.645631 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:56.700432 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Pushing event updated for resources: {'Port': ['ID=7310f663-89c8-4b45-b408-e61f219f9e2a,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:56.714056 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:56.717041 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:56.724247 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:56.730303 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:56.740268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-aba87b5b-2c74-44de-879b-fb0d2f648574 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:56.742657 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Usage tracker for resource:security_group_rule and tenant:736ad68c74974f2783df846318bbe77d is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:56.747022 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:36:56.749051 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:56.761752 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] 10.222.0.81 "PUT /v2.0/routers/18300301-a2ad-4993-90fe-7c3b01d4d555/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.9184818
Jun 01 12:36:56.764350 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:56.798712 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=a74a369e611a4f0bbec632c6291d75ee&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8701911
Jun 01 12:36:56.802654 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59452) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:56.807584 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b448ec8-b907-47ee-8cd2-47dd29d6d513 req-62580999-2956-493d-b56b-54186967b998 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:56.815726 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7b448ec8-b907-47ee-8cd2-47dd29d6d513 req-62580999-2956-493d-b56b-54186967b998 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.5333886
Jun 01 12:36:56.839607 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8616209-c9b6-474a-b36f-45a58996575a,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:56.846061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:56.853688 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ccd3be-ddb3-4984-a1dc-8b67dc775fa2 req-1cf6a655-ca8d-42dc-8852-790fc24d648f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:56.872931 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:36:56.873960 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-26ccd3be-ddb3-4984-a1dc-8b67dc775fa2 req-1cf6a655-ca8d-42dc-8852-790fc24d648f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2123399
Jun 01 12:36:56.885403 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5bf566e5-caec-4a88-9519-fee73db9d6b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:56.886953 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-5bf566e5-caec-4a88-9519-fee73db9d6b5 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=de15817fec1344958f88c8a9b4ad3a81&device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 1096 time: 0.2753546
Jun 01 12:36:56.891676 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-b33082d9-0e2d-4afd-8fa6-9e6056ef69af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:56.893877 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-b33082d9-0e2d-4afd-8fa6-9e6056ef69af service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.3242702
Jun 01 12:36:56.905646 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Sync routers for ids ['18300301-a2ad-4993-90fe-7c3b01d4d555'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:36:56.910765 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7b448ec8-b907-47ee-8cd2-47dd29d6d513 req-e1216ee6-2f3a-4c02-8382-4e8b93897ed0 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0913074
Jun 01 12:36:56.918503 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Routers {'18300301-a2ad-4993-90fe-7c3b01d4d555'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:56.935228 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fecf40>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['18300301-a2ad-4993-90fe-7c3b01d4d555'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:57.025758 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-26ccd3be-ddb3-4984-a1dc-8b67dc775fa2 req-80af378d-5d77-4d54-ae55-4f0d4600cc6a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1455398
Jun 01 12:36:57.063389 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:36:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15feb592-006c-4dc1-815b-eff5fb31453c x-openstack-request-id: req-15feb592-006c-4dc1-815b-eff5fb31453c {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:36:57.063903 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cad7448c-1bae-4ddf-82aa-705653c7b1fe", "tag": "7310f663-89c8-4b45-b408-e61f219f9e2a", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:36:57.064443 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-15feb592-006c-4dc1-815b-eff5fb31453c {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:36:57.064957 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'tag': '7310f663-89c8-4b45-b408-e61f219f9e2a', 'status': 'completed', 'code': 200}
Jun 01 12:36:57.087449 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-e94b97a9-34e0-472a-b801-502558cc6a56 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=7310f663-89c8-4b45-b408-e61f219f9e2a HTTP/1.1" status: 200  len: 217 time: 0.1745093
Jun 01 12:36:57.099077 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.116468 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1c1de546-761e-443c-9484-ee6cb9694b62 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:57.161109 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.167871 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.175703 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.187419 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-07b44188-e668-4ec7-b6e5-34e9ed29a758 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:57.262339 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=736ad68c74974f2783df846318bbe77d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6557806
Jun 01 12:36:57.263176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59460) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:57.283978 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58fcee6f-d0fa-42db-a862-ae2c363ef218,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:57.284733 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-f20265a4-1ef4-43a1-b679-63651456587f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:57.286614 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-f20265a4-1ef4-43a1-b679-63651456587f service neutron] 10.222.0.95 "GET /v2.0/subnets?id=0c11cd35-b97b-4949-aaa4-6eb3505216f7 HTTP/1.1" status: 200  len: 849 time: 0.0849879
Jun 01 12:36:57.295705 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:57.322521 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 1c1de546-761e-443c-9484-ee6cb9694b62 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:36:57.332745 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 1c1de546-761e-443c-9484-ee6cb9694b62 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:57.333173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.345609 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.351735 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-c832c0ae-6fa0-4298-a1fb-14e86d1186a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:57.366012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.369094 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8616209-c9b6-474a-b36f-45a58996575a,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:57.372054 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:57.400330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.401485 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/d8616209-c9b6-474a-b36f-45a58996575a HTTP/1.1" status: 204  len: 168 time: 0.5932260
Jun 01 12:36:57.405608 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Set router 18300301-a2ad-4993-90fe-7c3b01d4d555 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:36:57.406662 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.432663 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-b01c5e62-c309-4b33-8264-c90fa7402583 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1358516
Jun 01 12:36:57.486827 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.495260 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-977941c5-89b0-4695-947c-3f57ad6f140b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:57.513743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58fcee6f-d0fa-42db-a862-ae2c363ef218,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:57.516716 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:57.517694 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.520721 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/58fcee6f-d0fa-42db-a862-ae2c363ef218 HTTP/1.1" status: 204  len: 168 time: 0.2498908
Jun 01 12:36:57.567734 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-f3d27c4b-18a5-491e-aa9e-d986b0b8059f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:57.569610 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-f3d27c4b-18a5-491e-aa9e-d986b0b8059f service neutron] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 920 time: 0.6576924
Jun 01 12:36:57.815078 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59472) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:57.818958 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-abb8e9fd-0189-40d3-837e-1809e60585eb service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 200  len: 217 time: 0.1704819
Jun 01 12:36:57.822187 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-272221243', 'description': 'tempest-secgroup-smoke-272221243 description', 'project_id': '892af7572bdb454483d1279dcfc9ccb0'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:57.834988 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:57.839030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3cf26a-3502-42b0-ac0a-2bfeb0464552 req-4827eada-e246-4e5b-b660-7572dfa448b9 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:57.840610 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ac3cf26a-3502-42b0-ac0a-2bfeb0464552 req-4827eada-e246-4e5b-b660-7572dfa448b9 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 943 time: 0.6965659
Jun 01 12:36:57.857192 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:57.859575 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.862164 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:57.870778 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:57.887772 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.906047 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 1c1de546-761e-443c-9484-ee6cb9694b62, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=1c1de546-761e-443c-9484-ee6cb9694b62,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:36:57.918046 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:57.922402 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:57.926516 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:57.932944 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:57.943409 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:57.948739 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:57.956334 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-ae5b9139-ae46-4b1e-8da0-f43c7e5768d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:57.959686 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-ae5b9139-ae46-4b1e-8da0-f43c7e5768d7 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.1143675
Jun 01 12:36:57.986709 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-00b278aa-0422-4bcf-bb59-e5e6f0f6a81f service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5448020
Jun 01 12:36:58.071598 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=1c1de546-761e-443c-9484-ee6cb9694b62,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:58.076209 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:58.076391 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.088161 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.093147 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b1c97fa7-b828-4da6-97f9-2ae49c9cd762 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:58.126892 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fecf40>, [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39'}], 'enable_snat': True}, 'gw_port_id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:36:54Z', 'revision_number': 4, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port': {'id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:5d:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:48Z', 'updated_at': '2021-06-01T12:36:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'db362eaa-5ce3-4b55-a834-f2a50ec38ae6', 'name': '', 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'mac_address': 'fa:16:3e:2c:86:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': 'a630deea-a2cc-4a29-9c45-3180bc13da34', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:53Z', 'updated_at': '2021-06-01T12:36:55Z', 'revision_number': 2, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'subnets': [{'id': 'a630deea-a2cc-4a29-9c45-3180bc13da34', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:36:58.146578 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Checking router: 18300301-a2ad-4993-90fe-7c3b01d4d555 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:36:58.148794 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Updating router 18300301-a2ad-4993-90fe-7c3b01d4d555 port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:36:58.235618 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-48703e24-4bcd-4342-9242-d3aae9c190a7 req-43cf38d6-7046-49fa-9b91-c9ba42a7be2e service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1817820
Jun 01 12:36:58.245530 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-266066e7-1577-4fe0-9fb5-77338c75808d service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2576005
Jun 01 12:36:58.269909 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ac3cf26a-3502-42b0-ac0a-2bfeb0464552 req-1a4c25c6-4316-4093-93e0-3da59d54286a tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3085003
Jun 01 12:36:58.296472 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.347755 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'SecurityGroup': ['ID=886adde4-fecb-48e7-a65d-8c4b1eef5d0e,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:58.359516 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:58.366339 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.373972 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.5509334
Jun 01 12:36:58.373972 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59494) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:58.401944 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'security_group_rule': {'security_group_id': '886adde4-fecb-48e7-a65d-8c4b1eef5d0e', 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:58.424313 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:58.433268 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:58.439294 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:58.455446 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:58.489629 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.522922 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43cd5367-8035-4dd2-9779-534ff1811a1e req-17607232-b626-475f-9f14-8ae0a6d9d739 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:58.535848 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-43cd5367-8035-4dd2-9779-534ff1811a1e req-17607232-b626-475f-9f14-8ae0a6d9d739 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.3448222
Jun 01 12:36:58.591459 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-26a67772-9163-4b61-834b-57ce8be00a03 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3260431
Jun 01 12:36:58.619883 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-43cd5367-8035-4dd2-9779-534ff1811a1e req-05c62d4c-d8b6-49b9-997d-3333e1d9b2dc tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0827792
Jun 01 12:36:58.642043 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.647885 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.651909 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:58.680557 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a7d41065-c2b1-4ee6-8ed4-5fa540a336cf,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:58.687902 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:58.695349 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.697072 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3020151
Jun 01 12:36:58.700752 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59506) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:58.707365 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'security_group_rule': {'security_group_id': '886adde4-fecb-48e7-a65d-8c4b1eef5d0e', 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:58.714425 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:58.718751 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:58.722090 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:58.732744 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:58.762357 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.908849 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1c1de546-761e-443c-9484-ee6cb9694b62 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:36:58.990267 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.990486 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:58.998139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.000965 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-564b2d7f-57bb-41c1-badc-b15f5287d228 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:59.009865 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Transition to ACTIVE for port object db362eaa-5ce3-4b55-a834-f2a50ec38ae6 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:36:59.021239 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.025818 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:59.049813 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c8cc6b75-d94d-4345-893b-d1343ecd349c,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:59.060374 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.065326 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.3603892
Jun 01 12:36:59.065326 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:59.065566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59520) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:59.074408 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'security_group_rule': {'security_group_id': '886adde4-fecb-48e7-a65d-8c4b1eef5d0e', 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:59.087840 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:59.113373 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:59.125193 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:59.136326 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:59.172147 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.194680 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4091ea34-ff78-4f74-b113-f26b4ff05ada req-5032f4a9-2a4d-472b-afda-b1f6d7a6dada service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5615525
Jun 01 12:36:59.203051 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 1c1de546-761e-443c-9484-ee6cb9694b62 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:36:59.203445 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.208610 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb85e615-5de9-4a39-9a5c-71a711c22132 req-2a06bd8e-af35-438e-b8ed-1310ba6b9de0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:59.217075 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-eb85e615-5de9-4a39-9a5c-71a711c22132 req-2a06bd8e-af35-438e-b8ed-1310ba6b9de0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.6244757
Jun 01 12:36:59.244674 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-fab9599a-dc28-46a2-a7b8-f85b41f514af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:59.246881 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-fab9599a-dc28-46a2-a7b8-f85b41f514af service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=de15817fec1344958f88c8a9b4ad3a81&device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 1096 time: 0.6529906
Jun 01 12:36:59.333351 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-eb85e615-5de9-4a39-9a5c-71a711c22132 req-13bc3f97-e43e-4563-87f6-80b11325b9ba tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1149354
Jun 01 12:36:59.370045 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.379866 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.383893 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:59.452886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1708f00f-b15d-44cd-84dd-49d8eab6cbcf,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:59.456017 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:59.503745 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15add1d-d10b-4e07-ab43-1e49ff4b75dc None None] Pushing event updated for resources: {'Port': ['ID=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:36:59.509313 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.513516 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59538) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:36:59.513938 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4474072
Jun 01 12:36:59.535631 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'security_group_rule': {'security_group_id': '886adde4-fecb-48e7-a65d-8c4b1eef5d0e', 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:36:59.538328 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f15add1d-d10b-4e07-ab43-1e49ff4b75dc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.513s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:36:59.542399 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Attempting to bind port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:36:59.542999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Attempting to bind port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:36:59.543531 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Attempting to bind port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 on network 12269b2c-6505-4483-b715-3d56d83902f2 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:36:59.545030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:36:59.556834 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:36:59.557495 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Checking segment: {'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:36:59.558690 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.559230 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:36:59.559448 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Bound using segment: {'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:36:59.560101 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Bound port: db362eaa-5ce3-4b55-a834-f2a50ec38ae6, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f845736a-7d73-4a5c-9544-aa3e3e70137c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 774, 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:36:59.560680 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.572176 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:36:59.582848 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:36:59.589020 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-6cfc6271-a625-46fb-8987-3016b1acae7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:59.591519 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-6cfc6271-a625-46fb-8987-3016b1acae7c service neutron] 10.222.0.95 "GET /v2.0/networks?id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce HTTP/1.1" status: 200  len: 910 time: 0.3222325
Jun 01 12:36:59.662023 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78c47f68-e9ac-4fa9-af8c-d7af5794aaf1 req-fe4163d0-535c-4569-8c82-154a45893db7 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:59.669044 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-78c47f68-e9ac-4fa9-af8c-d7af5794aaf1 req-fe4163d0-535c-4569-8c82-154a45893db7 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 943 time: 0.1178842
Jun 01 12:36:59.694935 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-f3e07f37-dc7b-47c5-9f5e-dbae1dc411b4 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=7310f663-89c8-4b45-b408-e61f219f9e2a HTTP/1.1" status: 200  len: 217 time: 0.0927882
Jun 01 12:36:59.696120 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.721781 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] For port db362eaa-5ce3-4b55-a834-f2a50ec38ae6, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:36:59.725756 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] For port db362eaa-5ce3-4b55-a834-f2a50ec38ae6, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,segment=NetworkSegment(f845736a-7d73-4a5c-9544-aa3e3e70137c),segment_id=f845736a-7d73-4a5c-9544-aa3e3e70137c)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:36:59.739664 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:36:59.741597 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-78c47f68-e9ac-4fa9-af8c-d7af5794aaf1 req-c35455b7-677b-4c18-b74f-f1e8d4f04c79 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0713303
Jun 01 12:36:59.765672 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7e2b8564-566c-4814-b262-6c0a50a3107c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:36:59.912694 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-0c6ea377-2f1a-4592-8c88-abc3724c0c15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:36:59.914234 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-0c6ea377-2f1a-4592-8c88-abc3724c0c15 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=0c11cd35-b97b-4949-aaa4-6eb3505216f7 HTTP/1.1" status: 200  len: 849 time: 0.2081859
Jun 01 12:36:59.954708 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Routers {'18300301-a2ad-4993-90fe-7c3b01d4d555'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:36:59.957403 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fecf40>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['18300301-a2ad-4993-90fe-7c3b01d4d555'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:00.023568 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.035703 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.045298 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-1e7d319b-7e07-46cb-ba59-6b0b1958043d service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=ad7e28fd-84b8-40b7-949c-94a41a55b4ce&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1162469
Jun 01 12:37:00.056877 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:00.058561 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15add1d-d10b-4e07-ab43-1e49ff4b75dc None None] Pushing event updated for resources: {'Port': ['ID=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:00.061943 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f15add1d-d10b-4e07-ab43-1e49ff4b75dc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:00.086122 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cab4a627-028f-4d2b-bce6-0826298cc4bb,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:00.131893 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3128a965-431d-41dd-9997-cb72a0a333c6 req-420e4385-43df-4ae2-af6e-3185da345432 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:00.139346 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3128a965-431d-41dd-9997-cb72a0a333c6 req-420e4385-43df-4ae2-af6e-3185da345432 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.3154588
Jun 01 12:37:00.139346 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:00.281593 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] Set router 18300301-a2ad-4993-90fe-7c3b01d4d555 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:00.302358 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.306031 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.7876303
Jun 01 12:37:00.306489 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59564) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:00.314961 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'security_group_rule': {'security_group_id': '886adde4-fecb-48e7-a65d-8c4b1eef5d0e', 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:00.327266 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:00.330269 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3128a965-431d-41dd-9997-cb72a0a333c6 req-1683bc48-6f70-4f44-9848-c0052dcbc236 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1033695
Jun 01 12:37:00.339119 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:00.354584 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-4c66dd99-f963-41da-9c36-0950a44a493d service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2727182
Jun 01 12:37:00.357876 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:00.373575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:00.385667 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.securitygroups_db [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Project 892af7572bdb454483d1279dcfc9ccb0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 12:37:00.396554 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.400204 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59574) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:00.541232 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.548406 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.590360 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d2e89ce4-e861-4cf2-a805-a34c4e913bcb tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:00.617742 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3983ad6-0f66-4c70-8c0b-94f24815fc98,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:00.620854 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.655994 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:00.663314 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8fff717a-eaed-407a-b55b-bbb79ced4d2d req-6618e498-aad0-4a24-b0f1-c6bcf7407af2 service neutron] 10.222.0.95 "GET /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3007760
Jun 01 12:37:00.664186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Usage tracker for resource:security_group_rule and tenant:1e2c51e53db5408f9b7704fdfda11bf6 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:00.667231 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:00.674099 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:00.692757 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.696368 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3861551
Jun 01 12:37:00.696368 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:00.701334 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59584) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:00.711849 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'security_group_rule': {'security_group_id': '886adde4-fecb-48e7-a65d-8c4b1eef5d0e', 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:00.720949 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:00.733449 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:security_group_rule and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:00.737395 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:00.744758 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:00.762233 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.securitygroups_db [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Project 892af7572bdb454483d1279dcfc9ccb0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 12:37:00.773078 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.791088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd80ef8-3ca6-45f6-9a02-0f6d4fa26214 req-46ba1545-7583-4d15-8974-dd5f2310b744 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:00.792623 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3dd80ef8-3ca6-45f6-9a02-0f6d4fa26214 req-46ba1545-7583-4d15-8974-dd5f2310b744 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2034388
Jun 01 12:37:00.831673 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.844374 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.849782 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 7310f663-89c8-4b45-b408-e61f219f9e2a details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:37:00.870680 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-911b20cc-1863-4fdc-a729-ff2c836a3f77 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:00.911920 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3dd80ef8-3ca6-45f6-9a02-0f6d4fa26214 req-e7666aa5-075e-485d-97cf-b4c7edd5f427 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1131406
Jun 01 12:37:00.917388 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.922349 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.925220 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9c9528bb-6d66-4973-8ccc-d186721cabfd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:00.938128 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=1e2c51e53db5408f9b7704fdfda11bf6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5347795
Jun 01 12:37:00.944840 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59594) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:00.961915 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=55fc66f1-23b1-436d-bd32-9eb6e6b496a8,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:00.964472 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:00.974005 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:00.975634 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.2733717
Jun 01 12:37:01.022600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a86302a2-d72f-47a0-bc78-48ca82804b4f,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:01.047068 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:01.128035 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fecf40>, [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39'}], 'enable_snat': True}, 'gw_port_id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:36:54Z', 'revision_number': 4, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port': {'id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:5d:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:48Z', 'updated_at': '2021-06-01T12:36:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'db362eaa-5ce3-4b55-a834-f2a50ec38ae6', 'name': '', 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'mac_address': 'fa:16:3e:2c:86:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': 'a630deea-a2cc-4a29-9c45-3180bc13da34', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:53Z', 'updated_at': '2021-06-01T12:36:59Z', 'revision_number': 4, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'subnets': [{'id': 'a630deea-a2cc-4a29-9c45-3180bc13da34', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:01.148822 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:01.152104 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c97f5643-f0aa-4db3-a2ec-6f44a7057efd None None] The sync data for ids ['18300301-a2ad-4993-90fe-7c3b01d4d555'] in dv-cinder-793515-2-iscsi is: [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39'}], 'enable_snat': True}, 'gw_port_id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:36:54Z', 'revision_number': 4, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port': {'id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:5d:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:48Z', 'updated_at': '2021-06-01T12:36:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'db362eaa-5ce3-4b55-a834-f2a50ec38ae6', 'name': '', 'network_id': '12269b2c-6505-4483-b715-3d56d83902f2', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'mac_address': 'fa:16:3e:2c:86:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_interface', 'standard_attr_id': 402, 'fixed_ips': [{'subnet_id': 'a630deea-a2cc-4a29-9c45-3180bc13da34', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:53Z', 'updated_at': '2021-06-01T12:36:59Z', 'revision_number': 4, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'subnets': [{'id': 'a630deea-a2cc-4a29-9c45-3180bc13da34', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:37:01.159192 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f590d16b-5901-4a00-9fc3-6f53bc1170c6 req-cec988b8-fcda-49a5-a953-4d2d674deb16 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:01.160886 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f590d16b-5901-4a00-9fc3-6f53bc1170c6 req-cec988b8-fcda-49a5-a953-4d2d674deb16 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 943 time: 0.1835721
Jun 01 12:37:01.161673 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 7310f663-89c8-4b45-b408-e61f219f9e2a, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=7310f663-89c8-4b45-b408-e61f219f9e2a,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:01.180365 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '7310f663-89c8-4b45-b408-e61f219f9e2a', 'network_id': 'ad7e28fd-84b8-40b7-949c-94a41a55b4ce', 'port_id': '7310f663-89c8-4b45-b408-e61f219f9e2a', 'mac_address': 'fa:16:3e:54:51:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 775, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0c11cd35-b97b-4949-aaa4-6eb3505216f7', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:37:01.263099 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:01.266675 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:01.292950 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7310f663-89c8-4b45-b408-e61f219f9e2a {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:37:01.310778 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 7310f663-89c8-4b45-b408-e61f219f9e2a, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=7310f663-89c8-4b45-b408-e61f219f9e2a,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:01.319334 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:01.321463 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:01.341236 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f590d16b-5901-4a00-9fc3-6f53bc1170c6 req-75b547ab-b3c4-4ab1-865e-7048db8f185c tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1705339
Jun 01 12:37:01.430395 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:01.440604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a5a107fa-ca42-4800-b7e9-029ce0e2991a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:01.459173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=7310f663-89c8-4b45-b408-e61f219f9e2a,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:01.463238 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:01.472126 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a86302a2-d72f-47a0-bc78-48ca82804b4f,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:01.474909 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:01.477119 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a86302a2-d72f-47a0-bc78-48ca82804b4f HTTP/1.1" status: 204  len: 168 time: 0.5306213
Jun 01 12:37:01.479486 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:01.622818 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['7310f663-89c8-4b45-b408-e61f219f9e2a'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:37:01.719333 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57bc74a0-99f8-4f41-bc36-c36b9a321632 req-c987c8ba-21d3-41c8-91d4-73c1b7b10ab3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:01.720949 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-57bc74a0-99f8-4f41-bc36-c36b9a321632 req-c987c8ba-21d3-41c8-91d4-73c1b7b10ab3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1601553
Jun 01 12:37:01.840464 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-57bc74a0-99f8-4f41-bc36-c36b9a321632 req-ccec6743-090d-4b6b-b840-dcea6fcbe0cf tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1129677
Jun 01 12:37:02.193320 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25c88010-574a-49e7-a85a-824f5bed8fe0 req-cb1fceb6-9e42-4a52-86ab-4adfc5afb545 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:02.194897 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-25c88010-574a-49e7-a85a-824f5bed8fe0 req-cb1fceb6-9e42-4a52-86ab-4adfc5afb545 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1158838
Jun 01 12:37:02.257025 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-25c88010-574a-49e7-a85a-824f5bed8fe0 req-cac4e760-4a36-4f11-a63a-51c342403463 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0550358
Jun 01 12:37:02.473541 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59696) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:02.554351 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0d0e08-f4bd-47e3-bf35-0ae2a909320d req-37b8805a-4d2d-44a9-beab-eb723f635298 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:02.555944 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3d0d0e08-f4bd-47e3-bf35-0ae2a909320d req-37b8805a-4d2d-44a9-beab-eb723f635298 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 944 time: 0.0993402
Jun 01 12:37:02.629798 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:02.632205 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3d0d0e08-f4bd-47e3-bf35-0ae2a909320d req-71a31853-2363-4d4b-81f5-bfb2f8831d1e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0680139
Jun 01 12:37:02.653110 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:02.657168 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Usage tracker for resource:security_group_rule and tenant:0afdf27686e54def8f5b5add1ae46c1b is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:02.660817 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:02.666950 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:02.772493 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:02.777043 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:02.796468 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59712) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:02.804895 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4b2c6d1b-78c9-4543-abc4-5ddb70d1de3f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.004s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:02.847330 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3fdfb524-ef22-4fec-9fce-5de7830fceff,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:02.851675 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0afdf27686e54def8f5b5add1ae46c1b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3770304
Jun 01 12:37:02.852666 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:02.853803 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 7310f663-89c8-4b45-b408-e61f219f9e2a up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:02.854456 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59718) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:02.923246 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device db362eaa-5ce3-4b55-a834-f2a50ec38ae6 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:02.962426 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:02.980324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-4979451-network', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:02.992444 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:03.002097 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Usage tracker for resource:network and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:03.006021 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.013851 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:03.025979 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:03.028535 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 7310f663-89c8-4b45-b408-e61f219f9e2a completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:03.035814 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:03.043252 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 7310f663-89c8-4b45-b408-e61f219f9e2a triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:03.043936 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.077302 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Made reservation on behalf of a4d9bab00fe345e0b899bc42ea4416e0 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:03.080356 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.087730 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:03.088101 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.096262 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.112158 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:03.121610 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:03.123434 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e72b302e-8077-4fcc-a379-543f5d7038b4 req-b20bbe1c-bc18-477a-8513-aa0eb5483185 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:03.125237 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:03.127928 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e72b302e-8077-4fcc-a379-543f5d7038b4 req-b20bbe1c-bc18-477a-8513-aa0eb5483185 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1459606
Jun 01 12:37:03.131541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:03.206043 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.216829 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1b3d7508-3760-4da3-8343-699d3d68dc70 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:03.250355 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3fdfb524-ef22-4fec-9fce-5de7830fceff,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:03.256152 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:03.260028 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.261383 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/3fdfb524-ef22-4fec-9fce-5de7830fceff HTTP/1.1" status: 204  len: 168 time: 0.4041584
Jun 01 12:37:03.274292 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e72b302e-8077-4fcc-a379-543f5d7038b4 req-8b3f159c-0e27-4fd6-bb92-ef40d3dabb22 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1296108
Jun 01 12:37:03.285548 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.292134 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.297850 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-16ecd9c2-df83-495c-86c3-bfadcfb3f11a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:03.355432 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11d5a78d-7a8b-4472-a38e-9ee000378394,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:03.358450 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] vlan segment allocate from pool success with {'vlan_id': 792, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:37:03.361678 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:03.370660 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.370869 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.371457 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Added segment cf66ca3e-849f-4c7a-ac26-44c6330098be of type vlan for network 8c58f5e9-2554-475d-a254-a02b35fda51b
Jun 01 12:37:03.402929 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.408548 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.444857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port db362eaa-5ce3-4b55-a834-f2a50ec38ae6, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,segment=NetworkSegment(f845736a-7d73-4a5c-9544-aa3e3e70137c),segment_id=f845736a-7d73-4a5c-9544-aa3e3e70137c)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:03.451198 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7310f663-89c8-4b45-b408-e61f219f9e2a'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:03.453354 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6783c63-9fe0-4b6c-84c0-967bc6588916" -d '{"events": [{"server_uuid": "cad7448c-1bae-4ddf-82aa-705653c7b1fe", "name": "network-vif-plugged", "status": "completed", "tag": "7310f663-89c8-4b45-b408-e61f219f9e2a"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:03.459614 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.463237 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f15add1d-d10b-4e07-ab43-1e49ff4b75dc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:03.497949 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.500598 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:03.501168 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.513524 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 7310f663-89c8-4b45-b408-e61f219f9e2a, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=7310f663-89c8-4b45-b408-e61f219f9e2a,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:03.515492 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81a79040-40cb-44fd-8589-60a687fcf1e2 x-openstack-request-id: req-81a79040-40cb-44fd-8589-60a687fcf1e2 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:03.515846 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cad7448c-1bae-4ddf-82aa-705653c7b1fe", "name": "network-vif-plugged", "status": "completed", "tag": "7310f663-89c8-4b45-b408-e61f219f9e2a", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:03.516038 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-81a79040-40cb-44fd-8589-60a687fcf1e2 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:03.516423 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7310f663-89c8-4b45-b408-e61f219f9e2a', 'code': 200}
Jun 01 12:37:03.521187 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:03.539647 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 879 time: 0.7419460
Jun 01 12:37:03.542917 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59736) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:03.545499 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:03.548596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.550483 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:03.551021 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:03.558271 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Request body: {'subnet': {'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-4979451-subnet', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:03.570326 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:03.576812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Usage tracker for resource:subnet and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:03.580743 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:03.590332 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:03.623896 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=7310f663-89c8-4b45-b408-e61f219f9e2a,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:03.627899 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:03.640475 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Pushing event updated for resources: {'Network': ['ID=8c58f5e9-2554-475d-a254-a02b35fda51b,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:03.647980 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:03.653751 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 8c58f5e9-2554-475d-a254-a02b35fda51b details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:37:03.660734 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b23b62-d158-4233-b209-a4af1bfa455a req-4f45cd1b-bfdc-4934-8a49-f55df77d93ee tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:03.668032 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c9b23b62-d158-4233-b209-a4af1bfa455a req-4f45cd1b-bfdc-4934-8a49-f55df77d93ee tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2198818
Jun 01 12:37:03.745530 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c9b23b62-d158-4233-b209-a4af1bfa455a req-dfbf850c-4ecc-4a04-b9d5-858dc35faf5a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0705202
Jun 01 12:37:03.763190 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59742) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:03.785793 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.804248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:03.808601 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Usage tracker for resource:security_group_rule and tenant:1e5caf84d399434880301a9e21ec95cc is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:03.811933 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:03.817925 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:03.874239 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Made reservation on behalf of a4d9bab00fe345e0b899bc42ea4416e0 for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:03.876732 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2345690'] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.912273 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.916900 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:03.924930 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-77fcd687-1663-4bdf-af87-7b77375055da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:03.966432 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=1e5caf84d399434880301a9e21ec95cc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2019513
Jun 01 12:37:03.967324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5de9a42-7d67-4658-83e4-e8b04468b0df,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:03.969580 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59746) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:03.971886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:04.030130 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.037797 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba76eed3-ddf4-422b-b7fc-cd7a8d91481e req-a6b6617b-9cfa-4a1a-be24-b1268d8f62de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:04.039273 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ba76eed3-ddf4-422b-b7fc-cd7a8d91481e req-a6b6617b-9cfa-4a1a-be24-b1268d8f62de service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 1098 time: 0.2421484
Jun 01 12:37:04.053774 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-031600f1-2a8f-4c50-a0fd-6d924900b885 req-d32ff05c-819d-46cc-bf34-db7cab58193e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:04.055159 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-031600f1-2a8f-4c50-a0fd-6d924900b885 req-d32ff05c-819d-46cc-bf34-db7cab58193e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 945 time: 0.2232492
Jun 01 12:37:04.056986 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.113663 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.120249 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-da614397-751d-4db2-9c8f-4fa918186fa2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:04.131849 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5de9a42-7d67-4658-83e4-e8b04468b0df,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:04.134121 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:04.139754 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.143506 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/d5de9a42-7d67-4658-83e4-e8b04468b0df HTTP/1.1" status: 204  len: 168 time: 0.1704516
Jun 01 12:37:04.174851 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ba76eed3-ddf4-422b-b7fc-cd7a8d91481e req-756975fa-38c6-43fa-8587-2ad80c2258fe service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1177785
Jun 01 12:37:04.182559 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-031600f1-2a8f-4c50-a0fd-6d924900b885 req-96d407fc-0f31-4edf-bd8e-f781cef05c0e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1102197
Jun 01 12:37:04.485458 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2610733', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2345676'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.489947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:04.493317 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e42c541-b7a7-40a0-ac40-81e40dad211f req-f953f9bd-82db-4ad8-9813-886b2fc09ee2 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:04.495767 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3e42c541-b7a7-40a0-ac40-81e40dad211f req-f953f9bd-82db-4ad8-9813-886b2fc09ee2 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1144502
Jun 01 12:37:04.563454 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=167cc367-6630-45a8-93ac-09106b9e41f1,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:04.571096 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3e42c541-b7a7-40a0-ac40-81e40dad211f req-16087d45-f4a5-439f-ba42-e71cd7792e6c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0647070
Jun 01 12:37:04.590123 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:04.601694 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Checking segment: {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:04.601694 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Network hostable DHCP agents. Network: 8c58f5e9-2554-475d-a254-a02b35fda51b, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:37:04.620821 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Network 8c58f5e9-2554-475d-a254-a02b35fda51b is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:37:04.634810 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 8c58f5e9-2554-475d-a254-a02b35fda51b) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:04.645620 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6aaa9d92-d19f-4152-a13c-34b83e40b65a None None] Network 8c58f5e9-2554-475d-a254-a02b35fda51b requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:37:04.647599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:04.648270 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.679490 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-829f91ba-db01-4097-9757-e4d74fca77a8 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 842 time: 1.1330261
Jun 01 12:37:04.679911 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59778) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:04.685958 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:04.691183 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:04.695309 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Usage tracker for resource:router and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:04.698334 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:04.706009 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:04.717559 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.719257 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.737207 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:04.888688 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device db362eaa-5ce3-4b55-a834-f2a50ec38ae6 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:04.950119 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-8c58f5e9-2554-475d-a254-a02b35fda51b', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:37:04.951132 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.033961 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b6ad5e-deb3-48c5-bc5c-58cb8b7a479c req-2a8ec362-6ad9-4611-bf4c-82f3d9d57028 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:05.051982 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f0b6ad5e-deb3-48c5-bc5c-58cb8b7a479c req-2a8ec362-6ad9-4611-bf4c-82f3d9d57028 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1476371
Jun 01 12:37:05.082704 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:05.083081 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.120178 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f0b6ad5e-deb3-48c5-bc5c-58cb8b7a479c req-75710d54-31fd-4aca-bebd-51215bbd505d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0664420
Jun 01 12:37:05.260261 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Allocated IP 172.20.0.2 (8c58f5e9-2554-475d-a254-a02b35fda51b/167cc367-6630-45a8-93ac-09106b9e41f1/fb34a56f-1475-4049-8869-d08164f3f3b5) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:05.328481 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.551883 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7d5231-7344-4f85-9c57-00995ff7c036 req-75bd3f8a-7cbc-4463-85d4-15f795c9ac90 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:05.553382 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9f7d5231-7344-4f85-9c57-00995ff7c036 req-75bd3f8a-7cbc-4463-85d4-15f795c9ac90 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 945 time: 0.2201800
Jun 01 12:37:05.613323 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.624114 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9f7d5231-7344-4f85-9c57-00995ff7c036 req-c7b96042-e7e6-4d53-b821-1d3e0990dc41 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0635324
Jun 01 12:37:05.631596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Transition to ACTIVE for port object fb34a56f-1475-4049-8869-d08164f3f3b5 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:05.656678 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Transition to ACTIVE for port object fb34a56f-1475-4049-8869-d08164f3f3b5 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:05.668629 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.672532 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6bf6d2e6-9d39-48c9-811f-687807979dd8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:05.784926 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Network 8c58f5e9-2554-475d-a254-a02b35fda51b is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:05.787920 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:05.792619 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:05.796034 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Pushing event updated for resources: {'Port': ['ID=fb34a56f-1475-4049-8869-d08164f3f3b5,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:05.799965 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:05.882843 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8659203e-8edd-42e9-95cb-c6f31b90aa2c req-ddeb4709-c65e-4a3b-9639-deda07fc9f68 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:05.884606 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8659203e-8edd-42e9-95cb-c6f31b90aa2c req-ddeb4709-c65e-4a3b-9639-deda07fc9f68 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1448541
Jun 01 12:37:05.932069 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.935832 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Attempting to bind port fb34a56f-1475-4049-8869-d08164f3f3b5 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:05.936227 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Attempting to bind port fb34a56f-1475-4049-8869-d08164f3f3b5 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:05.936657 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Attempting to bind port fb34a56f-1475-4049-8869-d08164f3f3b5 on network 8c58f5e9-2554-475d-a254-a02b35fda51b {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:05.946220 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:05.947734 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Checking segment: {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:05.948309 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.948766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Bound using segment: {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:05.951203 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Bound port: fb34a56f-1475-4049-8869-d08164f3f3b5, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:05.951596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:05.952839 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8659203e-8edd-42e9-95cb-c6f31b90aa2c req-a6a752ac-8f80-4202-a752-413ec718e8f1 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0591617
Jun 01 12:37:06.003191 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:06.081066 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] For port fb34a56f-1475-4049-8869-d08164f3f3b5, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:06.086106 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] For port fb34a56f-1475-4049-8869-d08164f3f3b5, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=fb34a56f-1475-4049-8869-d08164f3f3b5,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:06.091730 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:06.097150 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:06.226677 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Allocated IP 172.27.3.106 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/169a556b-064c-4cad-bb81-cab53dcd949f) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:06.264009 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Pushing event updated for resources: {'Port': ['ID=fb34a56f-1475-4049-8869-d08164f3f3b5,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:06.269364 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:06.431696 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d5458a-4276-4d76-9743-d86ea7d9c11e req-887ebafd-3a9a-46cf-92ef-352a2c568395 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:06.441217 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d1d5458a-4276-4d76-9743-d86ea7d9c11e req-887ebafd-3a9a-46cf-92ef-352a2c568395 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1053855
Jun 01 12:37:06.560662 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:06.577229 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d1d5458a-4276-4d76-9743-d86ea7d9c11e req-05fd482e-d961-400e-b243-84ea19e836b3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1318145
Jun 01 12:37:06.591635 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97da2a82-18f0-4466-a779-25873d88afe7 req-80860a3e-a0ae-4cb2-b96a-b6a05f2d4b77 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:06.604662 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-97da2a82-18f0-4466-a779-25873d88afe7 req-80860a3e-a0ae-4cb2-b96a-b6a05f2d4b77 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.2361546
Jun 01 12:37:06.633494 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-87ca075f-921e-40ac-ae38-08f793369286 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:06.635189 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-87ca075f-921e-40ac-ae38-08f793369286 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1098 time: 0.1707568
Jun 01 12:37:06.660801 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-97da2a82-18f0-4466-a779-25873d88afe7 req-f12a7219-a004-4d35-ba8b-9f31564cd460 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0585482
Jun 01 12:37:06.702072 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:06.707780 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0d464870-157d-49fc-b1d3-579214f670d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:06.773152 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:06.775931 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:06.779936 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:06.822354 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Pushing event updated for resources: {'Port': ['ID=169a556b-064c-4cad-bb81-cab53dcd949f,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:06.828199 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:06.842781 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-019e8dd1-b855-47b2-8ccb-880abe2221cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:06.844812 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-019e8dd1-b855-47b2-8ccb-880abe2221cb service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.1952658
Jun 01 12:37:06.925984 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device fb34a56f-1475-4049-8869-d08164f3f3b5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:06.975480 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-5b1e3cf0-b5ea-4af8-b5c2-cbe98a7d7ce3 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 1001 time: 0.1188555
Jun 01 12:37:07.054594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-31986052-46f5-4d89-b1c4-fcc8f92041c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:07.062029 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port fb34a56f-1475-4049-8869-d08164f3f3b5 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:07.068934 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-31986052-46f5-4d89-b1c4-fcc8f92041c9 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0836322
Jun 01 12:37:07.206169 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-ac4df7ac-62e8-43df-84d4-89194e83eac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:07.207827 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-ac4df7ac-62e8-43df-84d4-89194e83eac3 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1252747
Jun 01 12:37:07.382176 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-d758efd4-8405-407f-be4a-e64d438f6ab4 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1619229
Jun 01 12:37:07.478398 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:07.517938 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d61b7a3-5c28-4c4f-87a6-f3867b6195a1 None None] Network 8c58f5e9-2554-475d-a254-a02b35fda51b requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:37:07.587880 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7c1ee6-ee64-44fa-941b-1f7ebfbe6450 req-8b44a7fc-8135-4542-938d-4a673705ecb1 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:07.589379 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0e7c1ee6-ee64-44fa-941b-1f7ebfbe6450 req-8b44a7fc-8135-4542-938d-4a673705ecb1 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 945 time: 0.3067610
Jun 01 12:37:07.663331 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1d57b63f-1d3f-49eb-8c7d-7d4b020cdb43 req-96452cf5-8f90-477b-bd39-983e4d804b72 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2724614
Jun 01 12:37:07.666695 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Provisioning for port fb34a56f-1475-4049-8869-d08164f3f3b5 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:07.756168 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Provisioning complete for port fb34a56f-1475-4049-8869-d08164f3f3b5 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:07.756462 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:07.784969 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0e7c1ee6-ee64-44fa-941b-1f7ebfbe6450 req-2baf2393-e891-42d7-b544-347c80f3c6bc tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1014030
Jun 01 12:37:07.846178 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c841204-969c-4379-9b56-78581837cb18 req-74e02e13-6379-4a06-bf8c-aff79d9cc919 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:07.847662 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8c841204-969c-4379-9b56-78581837cb18 req-74e02e13-6379-4a06-bf8c-aff79d9cc919 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0917580
Jun 01 12:37:07.900990 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8c841204-969c-4379-9b56-78581837cb18 req-603c629b-d25c-412e-be5b-6595543afc46 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466695
Jun 01 12:37:07.964836 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:08.001826 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] For port fb34a56f-1475-4049-8869-d08164f3f3b5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=fb34a56f-1475-4049-8869-d08164f3f3b5,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:08.007335 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:08.010747 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:08.060081 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:08.083900 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Pushing event updated for resources: {'Port': ['ID=fb34a56f-1475-4049-8869-d08164f3f3b5,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:08.087211 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:08.145856 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db19da75-523f-4cab-b26c-eb3a655af58a req-c63c8586-b637-491c-bbaf-4793bc2fc91d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:08.147293 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-db19da75-523f-4cab-b26c-eb3a655af58a req-c63c8586-b637-491c-bbaf-4793bc2fc91d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1791260
Jun 01 12:37:08.228615 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5297cf73-e438-4b5e-9072-71309fb577b6 None None] Provisioning complete for port fb34a56f-1475-4049-8869-d08164f3f3b5 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:08.228889 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5297cf73-e438-4b5e-9072-71309fb577b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:08.276658 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-db19da75-523f-4cab-b26c-eb3a655af58a req-074f4c89-4ec8-41a2-83f5-695ab907d12e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1142235
Jun 01 12:37:08.321082 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Router 25520016-154b-4bde-8e0c-2e8576327298 is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91978) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:37:08.497182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:37:08.505541 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Sync routers for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:37:08.518536 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:08.519153 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25218460>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:08.525012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:08.526221 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 918 time: 3.8451674
Jun 01 12:37:08.529084 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59848) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:08.709661 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:08.893212 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device fb34a56f-1475-4049-8869-d08164f3f3b5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:08.986017 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port fb34a56f-1475-4049-8869-d08164f3f3b5 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:08.987103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.057109 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25218460>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:07Z', 'revision_number': 3, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:09.062719 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Checking router: 25520016-154b-4bde-8e0c-2e8576327298 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:37:09.063348 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Updating router 25520016-154b-4bde-8e0c-2e8576327298 port 169a556b-064c-4cad-bb81-cab53dcd949f binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:37:09.100424 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e645f7ac-b4c8-4958-849e-4d527ba1e222 req-69c60807-5074-4571-9e8b-3375478e33fb tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:09.101717 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e645f7ac-b4c8-4958-849e-4d527ba1e222 req-69c60807-5074-4571-9e8b-3375478e33fb tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 945 time: 0.1800427
Jun 01 12:37:09.148156 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.168732 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e645f7ac-b4c8-4958-849e-4d527ba1e222 req-3abf8898-f181-4a08-9584-772d817a460c tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0612936
Jun 01 12:37:09.360610 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35004829-07b9-4900-960d-f3d44731de4c req-bc65bced-caa2-4b9b-a9e8-92d6613a5004 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:09.362089 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-35004829-07b9-4900-960d-f3d44731de4c req-bc65bced-caa2-4b9b-a9e8-92d6613a5004 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2214143
Jun 01 12:37:09.462590 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-35004829-07b9-4900-960d-f3d44731de4c req-b39a76d3-e5b7-4d6c-a6a2-f0c23bea7410 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0890658
Jun 01 12:37:09.491491 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756368c2-46c5-4fb3-9d70-fbfa36f7d1f6 req-910f3fa9-071b-4b0a-af1d-8022c771ced6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:09.496660 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-756368c2-46c5-4fb3-9d70-fbfa36f7d1f6 req-910f3fa9-071b-4b0a-af1d-8022c771ced6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.0896106
Jun 01 12:37:09.532469 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.538914 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-756368c2-46c5-4fb3-9d70-fbfa36f7d1f6 req-312484d7-d8eb-4809-b24f-ea75464108bf tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413582
Jun 01 12:37:09.539437 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.550516 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Transition to ACTIVE for port object 169a556b-064c-4cad-bb81-cab53dcd949f will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:09.558002 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.562921 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-eeb51202-05b8-444b-8ed7-91cb5fedbc56 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:09.640591 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Attempting to bind port 169a556b-064c-4cad-bb81-cab53dcd949f on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:09.640959 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Attempting to bind port 169a556b-064c-4cad-bb81-cab53dcd949f by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:09.641320 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Attempting to bind port 169a556b-064c-4cad-bb81-cab53dcd949f on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:09.650948 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bdcccd6-dbc4-40d0-a3fb-2b6a99044086 None None] Pushing event updated for resources: {'Port': ['ID=169a556b-064c-4cad-bb81-cab53dcd949f,revision_number=2']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:09.660023 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-5bdcccd6-dbc4-40d0-a3fb-2b6a99044086 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:09.660928 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 36, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:09.661287 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:09.661668 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.662062 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:09.662571 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Bound port: 169a556b-064c-4cad-bb81-cab53dcd949f, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:09.662913 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.735136 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] For port 169a556b-064c-4cad-bb81-cab53dcd949f, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:09.738553 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] For port 169a556b-064c-4cad-bb81-cab53dcd949f, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=169a556b-064c-4cad-bb81-cab53dcd949f,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:09.743331 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.748207 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-9f84b5a3-b54f-4439-a443-557fdc76f3fe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:09.765572 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Allocated IP 172.20.0.1 (8c58f5e9-2554-475d-a254-a02b35fda51b/167cc367-6630-45a8-93ac-09106b9e41f1/0230aa64-ede6-4ece-9f90-6a3969943e98) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:09.826546 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:09.827150 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25218460>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:09.847572 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9cbc14ff-65f6-4f6f-9c32-3f34580e71c5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.896317 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bdcccd6-dbc4-40d0-a3fb-2b6a99044086 None None] Pushing event updated for resources: {'Port': ['ID=169a556b-064c-4cad-bb81-cab53dcd949f,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:09.907390 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-5bdcccd6-dbc4-40d0-a3fb-2b6a99044086 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:09.947050 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.963927 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.provisioning_blocks [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Transition to ACTIVE for port object 0230aa64-ede6-4ece-9f90-6a3969943e98 will not be triggered until provisioned by entity DHCP. {{(pid=91978) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:09.993078 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:09.997822 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:10.022727 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:10.063941 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Network 8c58f5e9-2554-475d-a254-a02b35fda51b is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:10.068537 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:10.074509 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:10.111948 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Pushing event updated for resources: {'Port': ['ID=0230aa64-ede6-4ece-9f90-6a3969943e98,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:10.125837 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:10.139911 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:10.297672 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:10.308787 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-04805297-5842-43dc-99ae-ef3bbb79c6be None None] Provisioning for port 0230aa64-ede6-4ece-9f90-6a3969943e98 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:10.315648 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-04805297-5842-43dc-99ae-ef3bbb79c6be None None] Provisioning complete for port 0230aa64-ede6-4ece-9f90-6a3969943e98 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:10.316497 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-04805297-5842-43dc-99ae-ef3bbb79c6be None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:10.350852 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25218460>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:07Z', 'revision_number': 3, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:10.355250 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba6c667c-db7f-4df4-bde4-0bd5348130c0 None None] The sync data for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi is: [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:07Z', 'revision_number': 3, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:37:10.377424 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-04805297-5842-43dc-99ae-ef3bbb79c6be None None] Port 0230aa64-ede6-4ece-9f90-6a3969943e98 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:37:10.527731 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ec0e0f-c19c-4855-a488-560111a948cd req-8146bb16-7d9d-4418-aa30-541ef5621aaf tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:10.529315 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-07ec0e0f-c19c-4855-a488-560111a948cd req-8146bb16-7d9d-4418-aa30-541ef5621aaf tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 945 time: 0.2329066
Jun 01 12:37:10.647607 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-07ec0e0f-c19c-4855-a488-560111a948cd req-eafc7b11-4319-4ac6-88d2-f874520e00cc tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0972395
Jun 01 12:37:10.687782 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:10.701267 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:10.725372 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fafa2d0-2af7-498f-a6e9-3e8e888fcba0 req-f39dd413-9be4-4ec5-9cbd-9678b1a171a0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:10.727093 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2fafa2d0-2af7-498f-a6e9-3e8e888fcba0 req-f39dd413-9be4-4ec5-9cbd-9678b1a171a0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1257489
Jun 01 12:37:10.770155 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:10.781471 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2fafa2d0-2af7-498f-a6e9-3e8e888fcba0 req-e493f641-cb89-43da-af7c-116f9310eb12 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479145
Jun 01 12:37:10.886647 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:10.892603 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 169a556b-064c-4cad-bb81-cab53dcd949f up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:10.979939 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 169a556b-064c-4cad-bb81-cab53dcd949f completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:10.987339 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 169a556b-064c-4cad-bb81-cab53dcd949f triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:10.987727 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:11.067406 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Pushing event updated for resources: {'Port': ['ID=0230aa64-ede6-4ece-9f90-6a3969943e98,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:11.081467 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.311s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:11.141709 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a008a7eb-f702-4ac2-b06d-590df06815df req-d19c7e5b-1448-4751-b3c5-96e7c835ea30 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:11.144224 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a008a7eb-f702-4ac2-b06d-590df06815df req-d19c7e5b-1448-4751-b3c5-96e7c835ea30 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.3183181
Jun 01 12:37:11.152021 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:11.177287 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 169a556b-064c-4cad-bb81-cab53dcd949f, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=169a556b-064c-4cad-bb81-cab53dcd949f,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:11.186960 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:11.189589 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:11.205025 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Network 8c58f5e9-2554-475d-a254-a02b35fda51b is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:11.208120 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:11.216280 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a008a7eb-f702-4ac2-b06d-590df06815df req-8d4b59cb-fd53-4f32-96b4-2adb87e90cc7 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0625050
Jun 01 12:37:11.347366 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=169a556b-064c-4cad-bb81-cab53dcd949f,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:11.350647 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:11.442897 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Router 25520016-154b-4bde-8e0c-2e8576327298 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:37:11.519182 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-ba09bc3b-6918-426a-8edd-9831a33ec96e None None] Provisioning complete for port 0230aa64-ede6-4ece-9f90-6a3969943e98 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:11.519916 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ba09bc3b-6918-426a-8edd-9831a33ec96e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:11.599238 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-ba09bc3b-6918-426a-8edd-9831a33ec96e None None] Port 0230aa64-ede6-4ece-9f90-6a3969943e98 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:37:11.640734 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:37:11.655950 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] 10.222.0.81 "PUT /v2.0/routers/25520016-154b-4bde-8e0c-2e8576327298/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.1216998
Jun 01 12:37:11.833859 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-0abd096c-f0ae-410d-8577-8f6c77d9b337 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:11.835527 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-0abd096c-f0ae-410d-8577-8f6c77d9b337 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 945 time: 0.1448567
Jun 01 12:37:12.062104 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eca0a84-31ac-41d8-8dce-262ff93065f4 req-814a9dff-2569-47cf-abf6-c32b9b712d9a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:12.071805 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.074522 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9eca0a84-31ac-41d8-8dce-262ff93065f4 req-814a9dff-2569-47cf-abf6-c32b9b712d9a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1305838
Jun 01 12:37:12.150839 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Deleting port 7310f663-89c8-4b45-b408-e61f219f9e2a {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:37:12.151094 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.176405 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2870d0fd-d022-4370-b3f2-e837d7641f82 req-2a9477ec-2932-407a-a3bd-0c1e9dd4f5d2 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:12.178382 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2870d0fd-d022-4370-b3f2-e837d7641f82 req-2a9477ec-2932-407a-a3bd-0c1e9dd4f5d2 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 945 time: 0.2715571
Jun 01 12:37:12.198178 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9eca0a84-31ac-41d8-8dce-262ff93065f4 req-5187ccca-2e1a-471d-94b6-d9e0f35ce21f tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1227705
Jun 01 12:37:12.253856 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Sync routers for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:37:12.268661 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:12.269297 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25114a60>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:36:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:12.369401 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2870d0fd-d022-4370-b3f2-e837d7641f82 req-152f5f5c-7f37-49a4-a0b5-9950c5d1a395 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/security-groups?id=618a82d3-59d4-4787-b8c4-7a2c63649640&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1847064
Jun 01 12:37:12.404004 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] For port 7310f663-89c8-4b45-b408-e61f219f9e2a, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=7310f663-89c8-4b45-b408-e61f219f9e2a,segment=NetworkSegment(1743f99e-0bfd-4a13-a9a5-3c94f99e75ec),segment_id=1743f99e-0bfd-4a13-a9a5-3c94f99e75ec)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:12.404493 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.485805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b899092-4aae-40c0-9dcb-de7bdce4eb0f req-c136d046-7abc-4071-8e95-3ba58fa80b0a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:12.496866 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3b899092-4aae-40c0-9dcb-de7bdce4eb0f req-c136d046-7abc-4071-8e95-3ba58fa80b0a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1587083
Jun 01 12:37:12.524245 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.593307 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Calling delete_port for 7310f663-89c8-4b45-b408-e61f219f9e2a owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:37:12.599858 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3b899092-4aae-40c0-9dcb-de7bdce4eb0f req-de327981-9aa2-4871-bbd6-14db43344c4e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0951972
Jun 01 12:37:12.694800 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-13442bb4-c8c5-41ba-a993-142ae8cf57d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.701644 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59922) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:12.712753 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:12.713958 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1025958974-network', 'tenant_id': '96abebccc0734fe388fae3749429552c'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:12.720714 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:12.727821 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Usage tracker for resource:network and tenant:96abebccc0734fe388fae3749429552c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:12.732388 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:12.741474 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:12.754776 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.763894 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:12.796353 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Made reservation on behalf of 96abebccc0734fe388fae3749429552c for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:12.799182 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.835230 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.844561 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Pushing event deleted for resources: {'Port': ['ID=7310f663-89c8-4b45-b408-e61f219f9e2a,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:12.850055 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:12.890276 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 169a556b-064c-4cad-bb81-cab53dcd949f up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:12.908027 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:12.949685 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Usage tracker for resource:security_group_rule and tenant:96abebccc0734fe388fae3749429552c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:12.952931 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] No DVR routers for this DVR port 7310f663-89c8-4b45-b408-e61f219f9e2a on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:37:12.955390 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:12.959292 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:12.962203 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'name': 'network-vif-deleted', 'tag': '7310f663-89c8-4b45-b408-e61f219f9e2a'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:12.964624 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a39fc01-a22c-4a16-8eaf-3ce818625533" -d '{"events": [{"server_uuid": "cad7448c-1bae-4ddf-82aa-705653c7b1fe", "name": "network-vif-deleted", "tag": "7310f663-89c8-4b45-b408-e61f219f9e2a"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:12.991513 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:12.998050 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d75a0e43-b132-47df-86ba-940738f9a2f8 req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.95 "DELETE /v2.0/ports/7310f663-89c8-4b45-b408-e61f219f9e2a HTTP/1.1" status: 204  len: 173 time: 1.1555815
Jun 01 12:37:13.023479 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc4c9d12-76bb-4153-b872-1deb4d51f1a2 x-openstack-request-id: req-bc4c9d12-76bb-4153-b872-1deb4d51f1a2 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:13.023954 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cad7448c-1bae-4ddf-82aa-705653c7b1fe", "name": "network-vif-deleted", "tag": "7310f663-89c8-4b45-b408-e61f219f9e2a", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:13.024766 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-bc4c9d12-76bb-4153-b872-1deb4d51f1a2 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:13.024855 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cad7448c-1bae-4ddf-82aa-705653c7b1fe', 'name': 'network-vif-deleted', 'tag': '7310f663-89c8-4b45-b408-e61f219f9e2a', 'status': 'completed', 'code': 200}
Jun 01 12:37:13.114408 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.119235 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.122785 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-883cb416-63ab-48d6-8b51-e149f6e8c576 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:13.144487 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 169a556b-064c-4cad-bb81-cab53dcd949f triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:13.144939 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.156630 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] vlan segment allocate from pool success with {'vlan_id': 785, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:37:13.167276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f21e766-3de9-4ad3-a551-9d20426ac9d6,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:13.171098 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:13.174523 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.174874 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Added segment 5d22763a-c728-4d3b-b291-ca264d604a65 of type vlan for network c0bcf70c-dd52-4c1c-bdfb-801657b54172
Jun 01 12:37:13.208696 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.229083 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25114a60>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 2, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:13.260326 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Checking router: 25520016-154b-4bde-8e0c-2e8576327298 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:37:13.260715 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Updating router 25520016-154b-4bde-8e0c-2e8576327298 port 0230aa64-ede6-4ece-9f90-6a3969943e98 binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:37:13.262934 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.264599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:13.265210 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.270635 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-64969960-5e12-4507-9533-a4bebb76275e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:13.342498 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.426740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Pushing event updated for resources: {'Network': ['ID=c0bcf70c-dd52-4c1c-bdfb-801657b54172,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:13.429740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:13.437099 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.7341702
Jun 01 12:37:13.437269 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59940) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:13.445373 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Request body: {'subnet': {'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1025958974-subnet', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:13.450334 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:13.454183 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Usage tracker for resource:subnet and tenant:96abebccc0734fe388fae3749429552c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:13.457107 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:13.463491 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:13.473874 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:37:13.482317 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Made reservation on behalf of 96abebccc0734fe388fae3749429552c for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:13.484541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3089724'] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.643702 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a4f9d6-7011-4bf9-8836-189ca52b5d80 req-88bff450-8269-4195-ba9d-41a7d41a42a0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:13.644802 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-5dbb925c-4ca8-4057-8755-f0c19fe19f60 req-b37f4ec8-463b-480a-8e25-d0b4b2d0d49e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Synchronizing usage tracker for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:13.645234 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-95a4f9d6-7011-4bf9-8836-189ca52b5d80 req-88bff450-8269-4195-ba9d-41a7d41a42a0 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2709107
Jun 01 12:37:13.661674 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-5dbb925c-4ca8-4057-8755-f0c19fe19f60 req-b37f4ec8-463b-480a-8e25-d0b4b2d0d49e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Unset dirty status for tenant:de15817fec1344958f88c8a9b4ad3a81 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:13.662927 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5dbb925c-4ca8-4057-8755-f0c19fe19f60 req-b37f4ec8-463b-480a-8e25-d0b4b2d0d49e tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 210 time: 0.1574922
Jun 01 12:37:13.744760 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-95a4f9d6-7011-4bf9-8836-189ca52b5d80 req-c2afecac-0275-45a2-8cf2-4be129fee22a tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0891728
Jun 01 12:37:13.814464 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.829418 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Transition to ACTIVE for port object 0230aa64-ede6-4ece-9f90-6a3969943e98 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:13.839827 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.848499 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-23281ab6-e3ee-4409-a58f-f545369277b7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:13.892954 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.989114 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2584281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3089706'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:13.993290 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0a348755-f090-4a61-be20-efba21ab75e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:14.040383 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59a6347-5ed1-43cd-a95e-87462f7cf53c None None] Pushing event updated for resources: {'Port': ['ID=0230aa64-ede6-4ece-9f90-6a3969943e98,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:14.046505 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-a59a6347-5ed1-43cd-a95e-87462f7cf53c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:14.078749 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Pushing event updated for resources: {'Subnet': ['ID=2e47d1b1-d844-4196-ad31-3dff92cabed9,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:14.081382 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:14.085947 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Checking segment: {'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:14.086295 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Network hostable DHCP agents. Network: c0bcf70c-dd52-4c1c-bdfb-801657b54172, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:37:14.098897 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Attempting to bind port 0230aa64-ede6-4ece-9f90-6a3969943e98 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:14.099251 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Attempting to bind port 0230aa64-ede6-4ece-9f90-6a3969943e98 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:14.099615 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Attempting to bind port 0230aa64-ede6-4ece-9f90-6a3969943e98 on network 8c58f5e9-2554-475d-a254-a02b35fda51b {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:14.105318 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:14.108496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Checking segment: {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:14.108496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.108496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Bound using segment: {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:14.108902 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:37:14.108999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Bound port: 0230aa64-ede6-4ece-9f90-6a3969943e98, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:14.108999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.119075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, c0bcf70c-dd52-4c1c-bdfb-801657b54172) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:14.129884 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:14.130461 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.154293 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-34eb49a8-df6e-497e-9fbb-731503d9a18d admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.7120931
Jun 01 12:37:14.154477 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 59946) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:14.155216 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4eb3d2c-097a-4a9c-a5d5-cad5a122bcda None None] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:37:14.160412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:14.165621 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:14.169650 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Usage tracker for resource:router and tenant:96abebccc0734fe388fae3749429552c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:14.172664 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:14.178985 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:14.189950 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.191012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.207756 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.297744 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] For port 0230aa64-ede6-4ece-9f90-6a3969943e98, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:14.310232 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] For port 0230aa64-ede6-4ece-9f90-6a3969943e98, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=0230aa64-ede6-4ece-9f90-6a3969943e98,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:14.319729 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.325877 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:14.458237 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a59a6347-5ed1-43cd-a95e-87462f7cf53c None None] Pushing event updated for resources: {'Port': ['ID=0230aa64-ede6-4ece-9f90-6a3969943e98,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:14.461006 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:14.461767 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25114a60>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:14.513314 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-a59a6347-5ed1-43cd-a95e-87462f7cf53c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:14.524279 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['7310f663-89c8-4b45-b408-e61f219f9e2a'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:37:14.577269 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.626666 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-c0bcf70c-dd52-4c1c-bdfb-801657b54172', 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'fixed_ips': [{'subnet_id': '2e47d1b1-d844-4196-ad31-3dff92cabed9'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:37:14.627471 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:14.800287 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:14.848302 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a09c5bcd-786d-4881-9f5f-eb883e01a989 req-4a75e61e-2c7d-429e-96a5-2baf8592c429 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 210 time: 0.0467677
Jun 01 12:37:15.002296 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.035643 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.078151 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Allocated IP 172.20.0.2 (c0bcf70c-dd52-4c1c-bdfb-801657b54172/2e47d1b1-d844-4196-ad31-3dff92cabed9/e65d8ecd-299b-4eb6-b38f-841cc50bf309) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:15.085461 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687626f4-c7e0-4af0-be5b-f7bd57b2b572 req-dbc3f019-c263-46a8-9500-46c1c1e2b568 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:15.086894 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-687626f4-c7e0-4af0-be5b-f7bd57b2b572 req-dbc3f019-c263-46a8-9500-46c1c1e2b568 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1989894
Jun 01 12:37:15.201891 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-687626f4-c7e0-4af0-be5b-f7bd57b2b572 req-f31deaab-25ae-4397-9d49-e0aa49a2b5da tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1050701
Jun 01 12:37:15.225266 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Allocated IP 172.27.3.207 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/3dcd55e7-e6e8-4791-8723-4a6e5142a7d5) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:15.345025 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25114a60>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:14Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:15.353334 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64eb86ba-1353-412e-9e9b-5ec8a453585a None None] The sync data for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi is: [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:14Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:37:15.365268 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.375750 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Transition to ACTIVE for port object e65d8ecd-299b-4eb6-b38f-841cc50bf309 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:15.384720 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.423671 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Transition to ACTIVE for port object e65d8ecd-299b-4eb6-b38f-841cc50bf309 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:15.434090 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.436025 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.441529 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-a59a6347-5ed1-43cd-a95e-87462f7cf53c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:15.442473 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.447274 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:15.521336 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:15.525294 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:15.529804 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:15.569503 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Pushing event updated for resources: {'Port': ['ID=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:15.608163 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:15.611617 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.615436 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.615807 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.616147 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.616494 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.616913 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.617262 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.617602 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.617939 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.618273 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.618619 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.618949 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:15.622093 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:15.624546 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:15.629147 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:15.669285 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Pushing event updated for resources: {'Port': ['ID=e65d8ecd-299b-4eb6-b38f-841cc50bf309,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:15.676189 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:15.736347 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Attempting to bind port e65d8ecd-299b-4eb6-b38f-841cc50bf309 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:15.736815 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Attempting to bind port e65d8ecd-299b-4eb6-b38f-841cc50bf309 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:15.737274 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Attempting to bind port e65d8ecd-299b-4eb6-b38f-841cc50bf309 on network c0bcf70c-dd52-4c1c-bdfb-801657b54172 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:15.743325 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:15.743715 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Checking segment: {'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:15.744318 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.744762 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Bound using segment: {'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:15.745250 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Bound port: e65d8ecd-299b-4eb6-b38f-841cc50bf309, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:15.745642 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.870251 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] For port e65d8ecd-299b-4eb6-b38f-841cc50bf309, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:15.874118 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] For port e65d8ecd-299b-4eb6-b38f-841cc50bf309, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=e65d8ecd-299b-4eb6-b38f-841cc50bf309,segment=NetworkSegment(5d22763a-c728-4d3b-b291-ca264d604a65),segment_id=5d22763a-c728-4d3b-b291-ca264d604a65)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:15.882070 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:15.896276 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:16.015748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Pushing event updated for resources: {'Port': ['ID=e65d8ecd-299b-4eb6-b38f-841cc50bf309,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:16.019974 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:16.109938 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e1e17543-327c-42a6-855e-dab8d9e6ee6f req-9965d9d5-7f32-4051-9dd5-ae1df6df814c tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] 10.222.0.81 "GET /v2.0/ports?device_id=cad7448c-1bae-4ddf-82aa-705653c7b1fe HTTP/1.1" status: 200  len: 210 time: 0.0597098
Jun 01 12:37:16.129865 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:16.648034 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f70114-6ca2-472f-8f63-e9f3e2ee6155 req-26b36b3a-fbbd-4962-8491-68cccc7f3262 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:16.649571 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-63f70114-6ca2-472f-8f63-e9f3e2ee6155 req-26b36b3a-fbbd-4962-8491-68cccc7f3262 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2162876
Jun 01 12:37:16.823546 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-63f70114-6ca2-472f-8f63-e9f3e2ee6155 req-43228ab7-d086-4df1-826b-80e3e267cb63 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0970004
Jun 01 12:37:16.836735 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.039810 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device e65d8ecd-299b-4eb6-b38f-841cc50bf309 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:17.127396 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port e65d8ecd-299b-4eb6-b38f-841cc50bf309 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:17.135954 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0230aa64-ede6-4ece-9f90-6a3969943e98 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:17.215376 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Router 50b97300-7fd3-46f7-943e-cf347dbb175e is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91978) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:37:17.239200 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 0230aa64-ede6-4ece-9f90-6a3969943e98 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:17.245119 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 0230aa64-ede6-4ece-9f90-6a3969943e98 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:17.245496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.314784 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4c49f9a-8de6-4fb5-a7ef-227d23c4b15f None None] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:37:17.416103 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:37:17.426690 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Sync routers for ids ['50b97300-7fd3-46f7-943e-cf347dbb175e'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:37:17.442112 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Routers {'50b97300-7fd3-46f7-943e-cf347dbb175e'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:17.443243 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25218ac0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['50b97300-7fd3-46f7-943e-cf347dbb175e'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:17.443740 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.445214 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-5324307b-e57f-4a4f-b022-6ac22839fb6e admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 3.2897210
Jun 01 12:37:17.448059 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 59998) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:17.463442 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Provisioning for port e65d8ecd-299b-4eb6-b38f-841cc50bf309 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:17.484441 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Provisioning complete for port e65d8ecd-299b-4eb6-b38f-841cc50bf309 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:17.484844 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.533389 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.640018 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 0230aa64-ede6-4ece-9f90-6a3969943e98, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=0230aa64-ede6-4ece-9f90-6a3969943e98,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:17.649812 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.653950 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-56d6dd4b-a8d1-4584-b23b-2570314fa10d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:17.655906 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Set router 50b97300-7fd3-46f7-943e-cf347dbb175e gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:17.814501 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.831085 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=0230aa64-ede6-4ece-9f90-6a3969943e98,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:17.836263 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:17.861254 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] For port e65d8ecd-299b-4eb6-b38f-841cc50bf309, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=e65d8ecd-299b-4eb6-b38f-841cc50bf309,segment=NetworkSegment(5d22763a-c728-4d3b-b291-ca264d604a65),segment_id=5d22763a-c728-4d3b-b291-ca264d604a65)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:17.881822 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:17.885825 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:18.034376 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Pushing event updated for resources: {'Port': ['ID=e65d8ecd-299b-4eb6-b38f-841cc50bf309,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:18.037798 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:18.172282 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7da6f129-001c-4b23-a3ca-61d83c67442e req-fd2b30b8-a1b7-4a18-b90e-4f311ca5efd3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:18.174307 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7da6f129-001c-4b23-a3ca-61d83c67442e req-fd2b30b8-a1b7-4a18-b90e-4f311ca5efd3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1397948
Jun 01 12:37:18.222768 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-c709f59c-b338-46c8-bbca-a161787bce7f None None] Provisioning complete for port e65d8ecd-299b-4eb6-b38f-841cc50bf309 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:18.223282 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c709f59c-b338-46c8-bbca-a161787bce7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.232230 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7da6f129-001c-4b23-a3ca-61d83c67442e req-09426f32-71c1-4e6a-81d5-aa297d1010f9 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489743
Jun 01 12:37:18.266584 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25218ac0>, [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207'}], 'enable_snat': True}, 'gw_port_id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:37:15Z', 'revision_number': 3, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port': {'id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:76:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:15Z', 'updated_at': '2021-06-01T12:37:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:18.271720 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Checking router: 50b97300-7fd3-46f7-943e-cf347dbb175e for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:37:18.272083 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Updating router 50b97300-7fd3-46f7-943e-cf347dbb175e port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:37:18.343414 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.481586 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.718506 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Allocated IP 172.20.0.1 (c0bcf70c-dd52-4c1c-bdfb-801657b54172/2e47d1b1-d844-4196-ad31-3dff92cabed9/b9fd6587-f312-4bff-a7f2-8cf07e521378) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:18.735133 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.748605 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Transition to ACTIVE for port object 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:18.756146 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.759919 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-5bdcccd6-dbc4-40d0-a3fb-2b6a99044086 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:18.833256 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Attempting to bind port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:18.833611 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Attempting to bind port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:18.833951 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Attempting to bind port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:18.849097 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1298bb8b-9a89-4527-8001-b29ec605b77c None None] Pushing event updated for resources: {'Port': ['ID=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,revision_number=2']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:18.851802 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:18.851802 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:18.852193 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.852482 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:18.853037 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Bound port: 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:18.853360 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.881310 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-1298bb8b-9a89-4527-8001-b29ec605b77c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:18.883799 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 7310f663-89c8-4b45-b408-e61f219f9e2a no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:37:18.916236 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.936304 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 7310f663-89c8-4b45-b408-e61f219f9e2a {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:37:18.936766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 7310f663-89c8-4b45-b408-e61f219f9e2a not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:37:18.937028 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Transition to ACTIVE for port object b9fd6587-f312-4bff-a7f2-8cf07e521378 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:18.942432 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] For port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:18.945904 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] For port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:18.950678 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.955005 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:18.968982 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:18.971073 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device e65d8ecd-299b-4eb6-b38f-841cc50bf309 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:18.973273 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:19.032026 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Routers {'50b97300-7fd3-46f7-943e-cf347dbb175e'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:19.033199 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25218ac0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['50b97300-7fd3-46f7-943e-cf347dbb175e'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:19.037084 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:19.039963 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:19.043582 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:19.046919 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port e65d8ecd-299b-4eb6-b38f-841cc50bf309 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:19.047306 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:19.076729 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Pushing event updated for resources: {'Port': ['ID=b9fd6587-f312-4bff-a7f2-8cf07e521378,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:19.088907 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:19.104756 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:19.105090 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1298bb8b-9a89-4527-8001-b29ec605b77c None None] Pushing event updated for resources: {'Port': ['ID=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:19.108378 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-1298bb8b-9a89-4527-8001-b29ec605b77c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:19.251414 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0230aa64-ede6-4ece-9f90-6a3969943e98 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:19.284716 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] Set router 50b97300-7fd3-46f7-943e-cf347dbb175e gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:19.288861 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:19.344277 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 0230aa64-ede6-4ece-9f90-6a3969943e98 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:19.345314 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:19.380013 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-c405dc2b-656f-4b38-8d48-f148ebe79460 None None] Provisioning for port b9fd6587-f312-4bff-a7f2-8cf07e521378 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:19.392785 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-c405dc2b-656f-4b38-8d48-f148ebe79460 None None] Provisioning complete for port b9fd6587-f312-4bff-a7f2-8cf07e521378 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:19.393251 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c405dc2b-656f-4b38-8d48-f148ebe79460 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:19.474422 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-c405dc2b-656f-4b38-8d48-f148ebe79460 None None] Port b9fd6587-f312-4bff-a7f2-8cf07e521378 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:37:19.619107 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25218ac0>, [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207'}], 'enable_snat': True}, 'gw_port_id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:37:15Z', 'revision_number': 3, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port': {'id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:76:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:15Z', 'updated_at': '2021-06-01T12:37:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:19.622972 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0593791-182b-4fed-b076-e30aa91359a6 None None] The sync data for ids ['50b97300-7fd3-46f7-943e-cf347dbb175e'] in dv-cinder-793515-2-iscsi is: [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207'}], 'enable_snat': True}, 'gw_port_id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:37:15Z', 'revision_number': 3, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port': {'id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:76:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:15Z', 'updated_at': '2021-06-01T12:37:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:37:19.660961 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58fe8dc-19ce-48b1-919f-d96c52a5a64c req-1f0dc803-ddc6-4b1e-9061-8752b92a2907 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:19.662419 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f58fe8dc-19ce-48b1-919f-d96c52a5a64c req-1f0dc803-ddc6-4b1e-9061-8752b92a2907 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2143462
Jun 01 12:37:19.743289 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f58fe8dc-19ce-48b1-919f-d96c52a5a64c req-d8903f93-7fbd-4db7-8842-b5d40c9ac242 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0656104
Jun 01 12:37:19.768980 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:19.773552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:19.801901 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6da64e52-51da-4f2f-a1a7-fe2f3fcea575 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:19.884749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Pushing event updated for resources: {'Port': ['ID=b9fd6587-f312-4bff-a7f2-8cf07e521378,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:19.889008 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:19.890132 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:20.069044 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:20.070260 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:20.290541 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Router 50b97300-7fd3-46f7-943e-cf347dbb175e has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:37:20.311485 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-e2acf764-646a-425d-b974-7b3980a20bb4 None None] Provisioning complete for port b9fd6587-f312-4bff-a7f2-8cf07e521378 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:20.311946 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e2acf764-646a-425d-b974-7b3980a20bb4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:20.384583 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-e2acf764-646a-425d-b974-7b3980a20bb4 None None] Port b9fd6587-f312-4bff-a7f2-8cf07e521378 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:37:20.543337 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:37:20.549937 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a3e5b1-14ea-421b-9728-9620f5606288 req-13cd75f6-8cfa-4818-acd8-a46cb0d0a3e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:20.551392 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a0a3e5b1-14ea-421b-9728-9620f5606288 req-13cd75f6-8cfa-4818-acd8-a46cb0d0a3e3 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.1961758
Jun 01 12:37:20.556435 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] 10.222.0.81 "PUT /v2.0/routers/50b97300-7fd3-46f7-943e-cf347dbb175e/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.1066294
Jun 01 12:37:20.912703 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:20.957153 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5059e120-f73d-4622-baea-5af545bba796 req-4f5c5906-e62e-4eda-afec-f515a77dcd44 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:20.964900 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5059e120-f73d-4622-baea-5af545bba796 req-4f5c5906-e62e-4eda-afec-f515a77dcd44 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1082747
Jun 01 12:37:20.988310 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:20.994735 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:20.995092 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.015990 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5059e120-f73d-4622-baea-5af545bba796 req-a2225d72-f204-4ffd-8740-fafd9a5829ba tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0498970
Jun 01 12:37:21.135459 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.155957 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:21.161293 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.163596 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6e9f54f3-fb6e-425a-9699-aac6f5545611 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:21.236398 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:21.239720 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:21.345957 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a0a3e5b1-14ea-421b-9728-9620f5606288 req-7ce7ed0e-bc2b-493e-a2f8-ff20beb7f693 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422921
Jun 01 12:37:21.400541 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60108) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:21.405573 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-737028728', 'description': 'tempest-secgroup-smoke-737028728 description', 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:21.412021 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:21.417454 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:21.420419 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:21.428659 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:21.442782 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.467444 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:21.471933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:21.475131 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:21.481053 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:21.558726 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.563710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.569146 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3e669dc9-cf75-46e2-8a29-be5bb9a1fe87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:21.613323 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'SecurityGroup': ['ID=769d56f0-3abb-4565-bb76-1e82a3f776a4,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:21.616408 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.620361 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.2163098
Jun 01 12:37:21.620747 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60124) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:21.626931 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'security_group_rule': {'security_group_id': '769d56f0-3abb-4565-bb76-1e82a3f776a4', 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:21.630223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:21.634699 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:21.638931 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:21.642743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:21.653037 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:21.674003 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.741732 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.747010 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.749335 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:21.772605 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=96b76c5a-0adf-49ca-9c33-66869daef8cd,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:21.775582 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:21.785112 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.786302 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-83d9ebd4-5004-4329-ac6d-c9070f7c02e4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1645017
Jun 01 12:37:21.789265 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60138) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:21.795101 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'security_group_rule': {'security_group_id': '769d56f0-3abb-4565-bb76-1e82a3f776a4', 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:21.802485 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:21.806973 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:21.810082 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:21.815940 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:21.835012 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.910269 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.917271 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.919342 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-62d67bb8-1944-4be8-b2ae-4b8da8549e3b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:21.942123 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Sync routers for ids ['50b97300-7fd3-46f7-943e-cf347dbb175e'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:37:21.942623 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66185d11-64d6-42b4-a6cd-2693f01ef74f,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:21.945022 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:21.953582 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:21.954879 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Routers {'50b97300-7fd3-46f7-943e-cf347dbb175e'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:21.955465 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1649847
Jun 01 12:37:21.955697 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a250ea910>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['50b97300-7fd3-46f7-943e-cf347dbb175e'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:21.958196 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60144) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:21.963318 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'security_group_rule': {'security_group_id': '769d56f0-3abb-4565-bb76-1e82a3f776a4', 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:21.969829 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:21.973706 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:21.977108 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:21.983080 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:22.000372 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.064103 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.069488 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.072372 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1098ca8a-df54-447e-a7bb-b156a3a8a951 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:22.107868 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.109168 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1499679
Jun 01 12:37:22.110009 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=112e4da0-71d3-4def-a7e5-4baed589f8e6,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:22.111878 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60154) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:22.114486 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-80837c70-3df0-48ff-a90f-9a28ec481509 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:22.123873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'security_group_rule': {'security_group_id': '769d56f0-3abb-4565-bb76-1e82a3f776a4', 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:22.130035 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:22.143396 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:22.147686 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:22.153111 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Set router 50b97300-7fd3-46f7-943e-cf347dbb175e gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:22.155465 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:22.219431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.293811 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb503c8-fbcf-4da4-a7ea-2d537fe576ea req-8f580acd-84e8-4263-ac72-9f48da053e32 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:22.295281 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-eeb503c8-fbcf-4da4-a7ea-2d537fe576ea req-8f580acd-84e8-4263-ac72-9f48da053e32 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1446116
Jun 01 12:37:22.300236 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.316145 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.322300 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-35f05435-b1ba-44a4-80d7-d0a00faf1d78 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:22.361128 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fbb1b177-f2cd-47e0-af8a-4f41ca958d4f,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:22.370826 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-eeb503c8-fbcf-4da4-a7ea-2d537fe576ea req-b0e5c5ea-fa92-4d85-8732-6138241bc8d4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0684566
Jun 01 12:37:22.376805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.377157 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.377548 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.377863 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.378191 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.378545 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.378859 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.379184 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.379529 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.379841 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.380174 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.380536 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:22.383701 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:22.384415 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.385630 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-51795480-5c0b-439c-ad9f-329c2df88c2e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2727382
Jun 01 12:37:22.388303 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60158) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:22.394172 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'security_group_rule': {'security_group_id': '769d56f0-3abb-4565-bb76-1e82a3f776a4', 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:22.400260 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:22.404318 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:22.407444 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:22.416765 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:22.434573 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.securitygroups_db [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Project a4d9bab00fe345e0b899bc42ea4416e0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 12:37:22.441174 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.540270 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a250ea910>, [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207'}], 'enable_snat': True}, 'gw_port_id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:37:19Z', 'revision_number': 4, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port': {'id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:76:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:15Z', 'updated_at': '2021-06-01T12:37:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'b9fd6587-f312-4bff-a7f2-8cf07e521378', 'name': '', 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'mac_address': 'fa:16:3e:5f:bc:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_interface', 'standard_attr_id': 471, 'fixed_ips': [{'subnet_id': '2e47d1b1-d844-4196-ad31-3dff92cabed9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:18Z', 'updated_at': '2021-06-01T12:37:19Z', 'revision_number': 2, 'project_id': '96abebccc0734fe388fae3749429552c', 'subnets': [{'id': '2e47d1b1-d844-4196-ad31-3dff92cabed9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:22.545179 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Checking router: 50b97300-7fd3-46f7-943e-cf347dbb175e for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:37:22.545330 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Updating router 50b97300-7fd3-46f7-943e-cf347dbb175e port b9fd6587-f312-4bff-a7f2-8cf07e521378 binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:37:22.593291 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.597847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.599942 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ba4eb504-bb55-42ef-b6ca-742722595be5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:22.601500 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.622665 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c7b234d4-9a80-44d8-9ca2-24ffcade4787,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:22.625125 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:22.633938 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.635168 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-e42e175b-5864-4791-ac7b-f05fbdfdbe2f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2456234
Jun 01 12:37:22.637985 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60164) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:22.643129 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'security_group_rule': {'security_group_id': '769d56f0-3abb-4565-bb76-1e82a3f776a4', 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:22.649071 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:22.653020 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:security_group_rule and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:22.655954 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:22.664552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:22.676010 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.securitygroups_db [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Project a4d9bab00fe345e0b899bc42ea4416e0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 12:37:22.681991 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.752097 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.756080 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.758216 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:22.783089 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2c68a0b8-adf8-436e-a66f-9b6e3a066849,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:22.792501 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:22.793683 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1547945
Jun 01 12:37:22.794627 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4d090bfd-7b74-4b02-a7de-290f9e3eae64 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:22.890203 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:23.039708 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:23.047696 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:23.048072 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:23.087089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Transition to ACTIVE for port object b9fd6587-f312-4bff-a7f2-8cf07e521378 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:23.101793 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:23.107591 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:23.314155 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d466a193-e3a8-4dc0-8766-749c696ac58f None None] Pushing event updated for resources: {'Port': ['ID=b9fd6587-f312-4bff-a7f2-8cf07e521378,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:23.322070 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-d466a193-e3a8-4dc0-8766-749c696ac58f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:23.432562 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Attempting to bind port b9fd6587-f312-4bff-a7f2-8cf07e521378 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:23.433272 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Attempting to bind port b9fd6587-f312-4bff-a7f2-8cf07e521378 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:23.433682 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Attempting to bind port b9fd6587-f312-4bff-a7f2-8cf07e521378 on network c0bcf70c-dd52-4c1c-bdfb-801657b54172 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:23.444980 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:23.445291 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Checking segment: {'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:23.445692 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:23.446156 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Bound using segment: {'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:23.446637 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Bound port: b9fd6587-f312-4bff-a7f2-8cf07e521378, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d22763a-c728-4d3b-b291-ca264d604a65', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 785, 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:23.447013 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:23.566233 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] For port b9fd6587-f312-4bff-a7f2-8cf07e521378, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:23.569391 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] For port b9fd6587-f312-4bff-a7f2-8cf07e521378, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=b9fd6587-f312-4bff-a7f2-8cf07e521378,segment=NetworkSegment(5d22763a-c728-4d3b-b291-ca264d604a65),segment_id=5d22763a-c728-4d3b-b291-ca264d604a65)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:23.574273 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:23.579651 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:23.629182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d3427ef-5a08-43b0-9869-a94d0c94ca0a req-a194445d-1cab-4f6c-9535-d4fdc3750703 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:23.633290 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2d3427ef-5a08-43b0-9869-a94d0c94ca0a req-a194445d-1cab-4f6c-9535-d4fdc3750703 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1139462
Jun 01 12:37:23.664066 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Routers {'50b97300-7fd3-46f7-943e-cf347dbb175e'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:23.664757 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a250ea910>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['50b97300-7fd3-46f7-943e-cf347dbb175e'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:23.695902 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2d3427ef-5a08-43b0-9869-a94d0c94ca0a req-fdb9fd62-d6b5-48bc-905d-ba7bdc6d3d67 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0547025
Jun 01 12:37:23.772036 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d466a193-e3a8-4dc0-8766-749c696ac58f None None] Pushing event updated for resources: {'Port': ['ID=b9fd6587-f312-4bff-a7f2-8cf07e521378,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:23.777470 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-d466a193-e3a8-4dc0-8766-749c696ac58f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:23.889229 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] Set router 50b97300-7fd3-46f7-943e-cf347dbb175e gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:24.250290 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a250ea910>, [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207'}], 'enable_snat': True}, 'gw_port_id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:37:19Z', 'revision_number': 4, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port': {'id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:76:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:15Z', 'updated_at': '2021-06-01T12:37:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'b9fd6587-f312-4bff-a7f2-8cf07e521378', 'name': '', 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'mac_address': 'fa:16:3e:5f:bc:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_interface', 'standard_attr_id': 471, 'fixed_ips': [{'subnet_id': '2e47d1b1-d844-4196-ad31-3dff92cabed9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:18Z', 'updated_at': '2021-06-01T12:37:23Z', 'revision_number': 4, 'project_id': '96abebccc0734fe388fae3749429552c', 'subnets': [{'id': '2e47d1b1-d844-4196-ad31-3dff92cabed9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:24.254527 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eea2d48f-30bd-4768-9175-852803e20b07 None None] The sync data for ids ['50b97300-7fd3-46f7-943e-cf347dbb175e'] in dv-cinder-793515-2-iscsi is: [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207'}], 'enable_snat': True}, 'gw_port_id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:37:19Z', 'revision_number': 4, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port': {'id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:76:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:15Z', 'updated_at': '2021-06-01T12:37:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'b9fd6587-f312-4bff-a7f2-8cf07e521378', 'name': '', 'network_id': 'c0bcf70c-dd52-4c1c-bdfb-801657b54172', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'mac_address': 'fa:16:3e:5f:bc:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_interface', 'standard_attr_id': 471, 'fixed_ips': [{'subnet_id': '2e47d1b1-d844-4196-ad31-3dff92cabed9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:18Z', 'updated_at': '2021-06-01T12:37:23Z', 'revision_number': 4, 'project_id': '96abebccc0734fe388fae3749429552c', 'subnets': [{'id': '2e47d1b1-d844-4196-ad31-3dff92cabed9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:37:24.957433 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca44198d-ad8c-42eb-a837-00b710e22423 req-b5e63e78-67d4-4ff4-a179-1fe3b7cb6393 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:24.965131 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca44198d-ad8c-42eb-a837-00b710e22423 req-b5e63e78-67d4-4ff4-a179-1fe3b7cb6393 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1293819
Jun 01 12:37:24.973075 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device b9fd6587-f312-4bff-a7f2-8cf07e521378 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:25.018692 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca44198d-ad8c-42eb-a837-00b710e22423 req-cebe9425-f840-43ce-8e0e-903346aa36de tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0523872
Jun 01 12:37:25.068867 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port b9fd6587-f312-4bff-a7f2-8cf07e521378 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:25.075367 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port b9fd6587-f312-4bff-a7f2-8cf07e521378 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:25.076026 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:25.258292 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:25.319857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port b9fd6587-f312-4bff-a7f2-8cf07e521378, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=b9fd6587-f312-4bff-a7f2-8cf07e521378,segment=NetworkSegment(5d22763a-c728-4d3b-b291-ca264d604a65),segment_id=5d22763a-c728-4d3b-b291-ca264d604a65)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:25.326239 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:25.330973 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:25.443996 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=b9fd6587-f312-4bff-a7f2-8cf07e521378,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:25.450151 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:25.724850 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-55fd4e4c-88ba-4d26-b3a6-87a957e08250 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:25.728936 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-55fd4e4c-88ba-4d26-b3a6-87a957e08250 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5bf4a909afd242fab0afa824fd49eade&device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 1099 time: 0.1363742
Jun 01 12:37:25.773906 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4feef4f-7a32-42d2-bb69-fa3241b128c5 req-fa286ca9-5bec-4be5-aabd-15d258f26362 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:25.775437 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e4feef4f-7a32-42d2-bb69-fa3241b128c5 req-fa286ca9-5bec-4be5-aabd-15d258f26362 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1450915
Jun 01 12:37:25.860819 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e4feef4f-7a32-42d2-bb69-fa3241b128c5 req-366a48cc-b50d-4172-87e0-45d9f416c617 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0680916
Jun 01 12:37:25.917759 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-9462911e-9ccf-4e23-8b58-f172e2fb6d84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:25.919572 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-9462911e-9ccf-4e23-8b58-f172e2fb6d84 service neutron] 10.222.0.95 "GET /v2.0/networks?id=5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 200  len: 920 time: 0.1826286
Jun 01 12:37:26.002092 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-882761bd-5156-406f-9eb0-00d1d5cd4c10 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 200  len: 217 time: 0.0739813
Jun 01 12:37:26.106543 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-36ef3fb4-e593-4aa7-a9e6-1ace07073f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:26.108380 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-36ef3fb4-e593-4aa7-a9e6-1ace07073f3b service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 200  len: 859 time: 0.0902901
Jun 01 12:37:26.167436 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-50aca585-0faa-42b0-93bb-c7991c24a93e service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=5cafd137-be6a-4c7c-b850-6777e5242610&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0494335
Jun 01 12:37:26.315308 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-6c9d9f70-1a37-4b18-852b-44ec04cbeb88 service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1374607
Jun 01 12:37:26.464136 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1bbdf16-892a-41a7-a7c5-adb922196a0c req-051a3ad7-2073-4d2b-8166-cf1ff8aae46f service neutron] 10.222.0.95 "GET /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1414516
Jun 01 12:37:26.986514 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device b9fd6587-f312-4bff-a7f2-8cf07e521378 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:27.174862 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60326) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:27.229907 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port b9fd6587-f312-4bff-a7f2-8cf07e521378 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:27.230676 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.268367 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7089f7f3-16ae-4dde-b43b-532015fb6393 req-1b02fc72-bcb2-4286-bf7c-7b7eb0cee36d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:27.280166 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7089f7f3-16ae-4dde-b43b-532015fb6393 req-1b02fc72-bcb2-4286-bf7c-7b7eb0cee36d tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1658578
Jun 01 12:37:27.365891 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7089f7f3-16ae-4dde-b43b-532015fb6393 req-c05154ca-e774-493d-a49a-aa246a4ba4f2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0823495
Jun 01 12:37:27.409015 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.425499 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:27.429393 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Usage tracker for resource:security_group_rule and tenant:314c51c29d664226a66ca6f786495f88 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:27.432236 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:27.438558 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:27.519410 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.524416 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.534198 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-010d6ee3-eecf-4c22-9354-51a6484fe69a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:27.587863 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0607e59f-f889-4421-b80e-a3c7bbfeeb10,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:27.591976 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:27.614602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60332) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:27.623342 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=314c51c29d664226a66ca6f786495f88&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4457142
Jun 01 12:37:27.699030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c287bfd7-64ce-4400-9039-4e5efbe0ee5c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.730223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c287bfd7-64ce-4400-9039-4e5efbe0ee5c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.832745 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c287bfd7-64ce-4400-9039-4e5efbe0ee5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.836465 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4ca38a2a-e8e4-4d7c-a980-8d3cfc65ef10 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:27.868942 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c287bfd7-64ce-4400-9039-4e5efbe0ee5c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0607e59f-f889-4421-b80e-a3c7bbfeeb10,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:27.876473 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c287bfd7-64ce-4400-9039-4e5efbe0ee5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:27.880815 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c287bfd7-64ce-4400-9039-4e5efbe0ee5c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:27.888100 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c287bfd7-64ce-4400-9039-4e5efbe0ee5c admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0607e59f-f889-4421-b80e-a3c7bbfeeb10 HTTP/1.1" status: 204  len: 168 time: 0.2717001
Jun 01 12:37:28.331250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60352) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:28.729455 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-443611bd-1009-4171-9467-ad80fe7122b2 req-aed73961-1516-48ab-a32b-7e751fbbcf19 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:28.732078 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-443611bd-1009-4171-9467-ad80fe7122b2 req-aed73961-1516-48ab-a32b-7e751fbbcf19 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1068423
Jun 01 12:37:28.777201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:28.818282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:28.830390 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-443611bd-1009-4171-9467-ad80fe7122b2 req-37b6119a-dfdd-48dd-ac1f-c0ab1a9e750b tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0901124
Jun 01 12:37:28.831741 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Usage tracker for resource:security_group_rule and tenant:c8abbb9cdd504cf4a33f5d79c6f96132 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:28.835504 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:28.845156 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:28.967194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:28.973140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:28.985310 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dbd37d2b-a389-4b02-88a4-3c67db8ca5b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:29.038581 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60374) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:29.038841 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c8abbb9cdd504cf4a33f5d79c6f96132&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7055430
Jun 01 12:37:29.041118 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=576ad569-b28c-47be-9248-f6be56a1f18c,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:29.044299 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:29.146522 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:29.185517 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-1727cd8e-41bc-4623-bb21-f20c13a1a4fe tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:29.202840 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:29.207032 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-1727cd8e-41bc-4623-bb21-f20c13a1a4fe tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:29.218132 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-1727cd8e-41bc-4623-bb21-f20c13a1a4fe tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-272221243&fields=id&tenant_id=892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 267 time: 0.1145229
Jun 01 12:37:29.450176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:29.459829 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-cd7a0ff4-da70-47f5-b5a2-545f87ed3f59 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:29.475391 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-29145616-0e2f-4c56-806c-c6dd16a41099 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:29.476123 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-29145616-0e2f-4c56-806c-c6dd16a41099 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:network {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:29.479156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=576ad569-b28c-47be-9248-f6be56a1f18c,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:29.485088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:29.495706 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:29.497666 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/576ad569-b28c-47be-9248-f6be56a1f18c HTTP/1.1" status: 204  len: 168 time: 0.4580452
Jun 01 12:37:29.503723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-29145616-0e2f-4c56-806c-c6dd16a41099 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:network {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:29.512544 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-29145616-0e2f-4c56-806c-c6dd16a41099 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 812 time: 0.2931068
Jun 01 12:37:29.537216 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-e1c0b5f9-48fe-453c-8034-522e024ed491 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/quotas/892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 375 time: 0.0233400
Jun 01 12:37:29.651507 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-a9e7513f-e8ac-43ba-90d7-a34c35cff635 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1128292
Jun 01 12:37:29.932059 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7b00b92b-d3b2-49e9-80e8-f6c7d9b0cda4 service neutron] 10.222.0.81 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2655079
Jun 01 12:37:30.195473 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fde9d06-1433-40a5-825b-7c63f7f721a6 req-c5bfc4c4-2408-4544-a434-fb03a26b398e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:30.197939 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2fde9d06-1433-40a5-825b-7c63f7f721a6 req-c5bfc4c4-2408-4544-a434-fb03a26b398e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1805258
Jun 01 12:37:30.277491 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-b921b376-2978-41dd-bc6f-4d0dcc518147 service neutron] 10.222.0.81 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3444729
Jun 01 12:37:30.285706 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2fde9d06-1433-40a5-825b-7c63f7f721a6 req-c2cd39d5-30fe-4856-b4c3-657890189cf1 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0781834
Jun 01 12:37:32.248171 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-30efc378-c27f-43d5-9224-47a9176bd6d4 req-aa806a3c-c9f0-4daf-9de2-a8c58a90def0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:32.294500 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-30efc378-c27f-43d5-9224-47a9176bd6d4 req-aa806a3c-c9f0-4daf-9de2-a8c58a90def0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:32.304010 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-30efc378-c27f-43d5-9224-47a9176bd6d4 req-aa806a3c-c9f0-4daf-9de2-a8c58a90def0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 210 time: 0.1226108
Jun 01 12:37:33.530287 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bd998cc7-a089-4054-a846-2bbc12f842a5 req-5b7d6454-4806-4b1f-8d7f-cbd245674850 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 210 time: 0.0560758
Jun 01 12:37:33.564914 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-2609ce00-9d56-4a26-b67b-335f37c64765 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:33.567076 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-2609ce00-9d56-4a26-b67b-335f37c64765 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 812 time: 0.2026014
Jun 01 12:37:33.620373 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-37991516-07ad-4f8f-af7b-515fea866008 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 379 time: 0.0443356
Jun 01 12:37:33.636640 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'port': {'device_id': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'admin_state_up': True, 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'security_groups': ['886adde4-fecb-48e7-a65d-8c4b1eef5d0e']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:33.800874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:33.811814 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:33.824745 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Made reservation on behalf of 892af7572bdb454483d1279dcfc9ccb0 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:33.829313 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:33.873618 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:37:34.009080 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Allocated IP 172.20.0.12 (42f63911-56d5-4572-8431-a99e560ca482/056def2a-a8b2-4665-b4ba-cc9e031e8b58/30a14b45-81e5-4718-a910-a6b768fc753f) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:34.223466 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:34.239108 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Transition to ACTIVE for port object 30a14b45-81e5-4718-a910-a6b768fc753f will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:34.264072 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:34.270347 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:34.338852 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Network 42f63911-56d5-4572-8431-a99e560ca482 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:34.341762 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:34.346253 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:34.391979 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=30a14b45-81e5-4718-a910-a6b768fc753f,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:34.404421 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:34.433462 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:34.433948 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:34.475448 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8430011
Jun 01 12:37:34.488441 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Request body: {'port': {'device_id': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:34.602499 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-50e7a7cd-3158-4777-9240-cde5d83108b0 None None] Provisioning for port 30a14b45-81e5-4718-a910-a6b768fc753f completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:34.614964 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-50e7a7cd-3158-4777-9240-cde5d83108b0 None None] Provisioning complete for port 30a14b45-81e5-4718-a910-a6b768fc753f triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:34.615816 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-50e7a7cd-3158-4777-9240-cde5d83108b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:34.673035 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:34.748280 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-50e7a7cd-3158-4777-9240-cde5d83108b0 None None] Port 30a14b45-81e5-4718-a910-a6b768fc753f cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:37:34.808546 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1918af23-14bc-40a4-963b-567ec98a9263 req-a2149b81-1522-45e1-9ac5-4fe50e721cc7 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:34.810683 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1918af23-14bc-40a4-963b-567ec98a9263 req-a2149b81-1522-45e1-9ac5-4fe50e721cc7 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 932 time: 0.1237543
Jun 01 12:37:34.885596 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-1918af23-14bc-40a4-963b-567ec98a9263 req-396b5e54-61a3-41b8-b8dd-0e4873b5c3ef tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:34.902466 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-1918af23-14bc-40a4-963b-567ec98a9263 req-396b5e54-61a3-41b8-b8dd-0e4873b5c3ef tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:34.904178 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1918af23-14bc-40a4-963b-567ec98a9263 req-396b5e54-61a3-41b8-b8dd-0e4873b5c3ef tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0814686
Jun 01 12:37:35.148602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 30a14b45-81e5-4718-a910-a6b768fc753f {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:37:35.162303 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:35.179805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Transition to ACTIVE for port object 30a14b45-81e5-4718-a910-a6b768fc753f will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:35.184586 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:35.191930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:35.410976 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Pushing event updated for resources: {'Port': ['ID=30a14b45-81e5-4718-a910-a6b768fc753f,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:35.413903 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:35.542161 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-945fbb8e-f4b5-4e4d-b9cb-f6614ec60549 req-017ae1c9-b5bd-403f-b041-429e7d2f9a93 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:35.544169 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Attempting to bind port 30a14b45-81e5-4718-a910-a6b768fc753f on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:35.544838 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Attempting to bind port 30a14b45-81e5-4718-a910-a6b768fc753f by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:35.545270 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Attempting to bind port 30a14b45-81e5-4718-a910-a6b768fc753f on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:35.553430 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Port 30a14b45-81e5-4718-a910-a6b768fc753f on network 42f63911-56d5-4572-8431-a99e560ca482 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:37:35.553806 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Attempting to bind port 30a14b45-81e5-4718-a910-a6b768fc753f on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:35.560672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:35.561122 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Checking segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:35.561630 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Bound using segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:35.562269 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Bound port: 30a14b45-81e5-4718-a910-a6b768fc753f, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:35.563384 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:35.564010 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-945fbb8e-f4b5-4e4d-b9cb-f6614ec60549 req-017ae1c9-b5bd-403f-b041-429e7d2f9a93 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1835053
Jun 01 12:37:35.620459 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-945fbb8e-f4b5-4e4d-b9cb-f6614ec60549 req-323b467f-b3bd-441b-8a91-ef1185d08990 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0552239
Jun 01 12:37:35.815062 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] For port 30a14b45-81e5-4718-a910-a6b768fc753f, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:35.818514 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] For port 30a14b45-81e5-4718-a910-a6b768fc753f, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=30a14b45-81e5-4718-a910-a6b768fc753f,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:35.822526 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:35.826697 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:35.905375 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:35.906862 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:35.912623 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] 10.222.0.95 "PUT /v2.0/ports/30a14b45-81e5-4718-a910-a6b768fc753f HTTP/1.1" status: 200  len: 1094 time: 1.4266636
Jun 01 12:37:35.912623 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:35.915061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8711943a-6180-4cee-8685-2d6e60a93abd" -d '{"events": [{"name": "network-changed", "server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:35.939708 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Pushing event updated for resources: {'Port': ['ID=30a14b45-81e5-4718-a910-a6b768fc753f,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:35.943501 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:36.011698 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a82b6ef1-61ea-47c9-8bca-9ad0e05cf887 x-openstack-request-id: req-a82b6ef1-61ea-47c9-8bca-9ad0e05cf887 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:36.012602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:36.012890 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-a82b6ef1-61ea-47c9-8bca-9ad0e05cf887 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:36.013326 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f', 'status': 'completed', 'code': 200}
Jun 01 12:37:36.055045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-5b4e56ec-097f-463a-802d-15e883b28f4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:36.056907 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-5b4e56ec-097f-463a-802d-15e883b28f4a service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 1097 time: 0.1021423
Jun 01 12:37:36.145643 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-4054ac68-66db-423b-ae00-0775216d21b4 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=30a14b45-81e5-4718-a910-a6b768fc753f HTTP/1.1" status: 200  len: 217 time: 0.0796487
Jun 01 12:37:36.272932 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809ea01b-e5d1-4478-88df-93a4e7873546 req-ac0e25f8-c1cf-4ac1-acb6-f6a209244fc2 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:36.274589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-08ab260e-0e4e-4314-850f-3213b89b31e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:36.275028 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-809ea01b-e5d1-4478-88df-93a4e7873546 req-ac0e25f8-c1cf-4ac1-acb6-f6a209244fc2 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.1700251
Jun 01 12:37:36.276047 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-08ab260e-0e4e-4314-850f-3213b89b31e3 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.1205947
Jun 01 12:37:36.329727 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-809ea01b-e5d1-4478-88df-93a4e7873546 req-2bad6283-27d6-4888-bf18-81f32f225701 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0483081
Jun 01 12:37:36.360846 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-d9180cc5-72b5-4803-a84e-412592861880 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:36.362573 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-d9180cc5-72b5-4803-a84e-412592861880 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0796049
Jun 01 12:37:36.520555 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-16d5da50-2358-441f-bc6c-ffdcd79355b3 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1494782
Jun 01 12:37:36.689464 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-82e0d4e0-2f6d-41b1-a8b7-0e2002e76716 req-a77438e8-7df2-4efc-9ef7-7bdd87d53425 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1554313
Jun 01 12:37:36.847409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8711943a-6180-4cee-8685-2d6e60a93abd req-df8d4f68-61b4-434e-98c6-f1319091981f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:36.850905 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8711943a-6180-4cee-8685-2d6e60a93abd req-df8d4f68-61b4-434e-98c6-f1319091981f service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 1097 time: 0.0958335
Jun 01 12:37:36.888532 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5391b28f-4cda-4e0b-aaea-ade4daf08aa9 req-8c5b9443-6c0b-444f-87e3-8d4fa790f131 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:36.891545 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5391b28f-4cda-4e0b-aaea-ade4daf08aa9 req-8c5b9443-6c0b-444f-87e3-8d4fa790f131 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1266592
Jun 01 12:37:36.959720 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5391b28f-4cda-4e0b-aaea-ade4daf08aa9 req-7f281b77-34c2-4e6e-9563-159b54ba5d7e tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0605326
Jun 01 12:37:37.012611 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8711943a-6180-4cee-8685-2d6e60a93abd req-eebf4c89-184e-4b83-b9d6-e551d1f3c7b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:37.014426 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8711943a-6180-4cee-8685-2d6e60a93abd req-eebf4c89-184e-4b83-b9d6-e551d1f3c7b2 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1568806
Jun 01 12:37:37.087895 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8711943a-6180-4cee-8685-2d6e60a93abd req-f89593ac-5d52-4831-a926-afcc6da1c715 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=30a14b45-81e5-4718-a910-a6b768fc753f HTTP/1.1" status: 200  len: 217 time: 0.0657389
Jun 01 12:37:37.160524 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8711943a-6180-4cee-8685-2d6e60a93abd req-de8f8b9d-8aa1-45a1-adbb-17506c6600e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:37.162490 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8711943a-6180-4cee-8685-2d6e60a93abd req-de8f8b9d-8aa1-45a1-adbb-17506c6600e8 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0678427
Jun 01 12:37:37.256807 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8711943a-6180-4cee-8685-2d6e60a93abd req-1c4e1af4-3324-4268-adfa-57ee21eab7f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:37.258346 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8711943a-6180-4cee-8685-2d6e60a93abd req-1c4e1af4-3324-4268-adfa-57ee21eab7f5 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0845482
Jun 01 12:37:37.409785 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8711943a-6180-4cee-8685-2d6e60a93abd req-002defb3-d791-4b0a-b17f-6b9625e649fd service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1423316
Jun 01 12:37:37.553848 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-337d248d-4968-4565-91b1-fe54b89b935b req-89b957ff-3ec7-46cb-ba4d-62f3f46ffae3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:37.555337 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-337d248d-4968-4565-91b1-fe54b89b935b req-89b957ff-3ec7-46cb-ba4d-62f3f46ffae3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.1008019
Jun 01 12:37:37.576217 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8711943a-6180-4cee-8685-2d6e60a93abd req-b514b192-19a3-411f-8c88-3269c01f820c service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1520557
Jun 01 12:37:37.610696 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-337d248d-4968-4565-91b1-fe54b89b935b req-b694ae8d-e77a-45e9-b168-a19a81e3d86b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0476384
Jun 01 12:37:38.068708 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-ed85da9c-67dd-44ce-ae0d-8d57a95f6923 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:38.070208 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-ed85da9c-67dd-44ce-ae0d-8d57a95f6923 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.0934381
Jun 01 12:37:38.200793 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90c2ee68-7f7d-443c-ab67-89d73e9251db req-53668b8a-2bdd-4119-ba96-560c00ef7e19 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:38.200793 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-90c2ee68-7f7d-443c-ab67-89d73e9251db req-53668b8a-2bdd-4119-ba96-560c00ef7e19 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 945 time: 0.1356223
Jun 01 12:37:38.270886 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Deleting port d61046d2-ead3-4c6a-a151-93c1f0fc8249 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:37:38.271235 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:38.293332 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-90c2ee68-7f7d-443c-ab67-89d73e9251db req-c70fc3c3-a7cb-4224-9150-f0e19e6141e2 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0820460
Jun 01 12:37:38.539277 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] For port d61046d2-ead3-4c6a-a151-93c1f0fc8249, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d61046d2-ead3-4c6a-a151-93c1f0fc8249,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:38.539637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:38.668864 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Calling delete_port for d61046d2-ead3-4c6a-a151-93c1f0fc8249 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:37:38.817879 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:38.831330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13236bbb-0be0-4e9f-8058-fe0deec8c703 req-bacdb1a1-0f99-4cf3-a5b6-533a2f94ac36 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:38.834584 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-13236bbb-0be0-4e9f-8058-fe0deec8c703 req-bacdb1a1-0f99-4cf3-a5b6-533a2f94ac36 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.0984173
Jun 01 12:37:38.836893 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['c612c626-62cb-4f01-863c-58dbaf411409', 'd61046d2-ead3-4c6a-a151-93c1f0fc8249'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:37:38.853105 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-470edce1-3fff-453e-9627-7b16d0307215 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:38.896549 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-13236bbb-0be0-4e9f-8058-fe0deec8c703 req-d13543ac-96ee-4e1e-9b91-62c70a6ebc32 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0504279
Jun 01 12:37:38.959882 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Pushing event deleted for resources: {'Port': ['ID=d61046d2-ead3-4c6a-a151-93c1f0fc8249,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:38.969218 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:39.008625 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] No DVR routers for this DVR port d61046d2-ead3-4c6a-a151-93c1f0fc8249 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:37:39.011683 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:39.016137 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '43b63720-9350-4913-8f50-5662b9575005', 'name': 'network-vif-deleted', 'tag': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:39.018528 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebac8377-76eb-4be1-8281-4a7ffd96ec3a" -d '{"events": [{"server_uuid": "43b63720-9350-4913-8f50-5662b9575005", "name": "network-vif-deleted", "tag": "d61046d2-ead3-4c6a-a151-93c1f0fc8249"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:39.034088 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8a9b885c-8b86-4af8-93e6-fb5ed63f1450 req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "DELETE /v2.0/ports/d61046d2-ead3-4c6a-a151-93c1f0fc8249 HTTP/1.1" status: 204  len: 173 time: 0.9577584
Jun 01 12:37:39.095113 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1598011-0a1f-4249-98b5-1f6d9a149223 x-openstack-request-id: req-e1598011-0a1f-4249-98b5-1f6d9a149223 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:39.096945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "43b63720-9350-4913-8f50-5662b9575005", "name": "network-vif-deleted", "tag": "d61046d2-ead3-4c6a-a151-93c1f0fc8249", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:39.097432 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-e1598011-0a1f-4249-98b5-1f6d9a149223 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:39.098023 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '43b63720-9350-4913-8f50-5662b9575005', 'name': 'network-vif-deleted', 'tag': 'd61046d2-ead3-4c6a-a151-93c1f0fc8249', 'status': 'completed', 'code': 200}
Jun 01 12:37:39.381959 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-13a9ffa0-8fe3-41ed-bd9d-f0dffa83cae4 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1021519
Jun 01 12:37:39.480327 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e242eb26-6a44-421c-88d8-f5b34a519857 req-b66f8a0f-85aa-42bc-9e8e-4da33b58a6c4 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=43b63720-9350-4913-8f50-5662b9575005 HTTP/1.1" status: 200  len: 210 time: 0.0465527
Jun 01 12:37:39.491863 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-303e75a0-8b47-4cd9-b588-51c4cce4a287 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:39.493538 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-303e75a0-8b47-4cd9-b588-51c4cce4a287 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1098 time: 0.0828807
Jun 01 12:37:39.660552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-2840b69e-534d-4f95-bb75-fd98f1f2e202 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:39.662292 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-2840b69e-534d-4f95-bb75-fd98f1f2e202 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.1418548
Jun 01 12:37:39.802136 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-ec3040d5-9c0c-4736-829d-f9f1c7aed577 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 1001 time: 0.1337528
Jun 01 12:37:39.847612 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-8c26ab30-5998-478f-bbf1-394579a70a20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:39.896290 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-91595b41-85a6-4cb3-8660-5ecb2354aa99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:39.898050 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-91595b41-85a6-4cb3-8660-5ecb2354aa99 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0892498
Jun 01 12:37:39.997509 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-534e4734-7f0c-4ca6-a92d-7a11cdd63164 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:39.999030 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-534e4734-7f0c-4ca6-a92d-7a11cdd63164 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0913794
Jun 01 12:37:40.098757 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb51a48-45ff-499e-a6c1-378f33f16ca0 req-a98dc86e-38bb-448d-94bf-d25aa4144b7f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:40.100504 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ddb51a48-45ff-499e-a6c1-378f33f16ca0 req-a98dc86e-38bb-448d-94bf-d25aa4144b7f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.0904124
Jun 01 12:37:40.156066 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ddb51a48-45ff-499e-a6c1-378f33f16ca0 req-a12a5218-0c7b-40b0-9b7c-bfe2f2b36b9b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0490685
Jun 01 12:37:40.181040 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-6e7a49b9-8987-4f60-8861-ed0bc143ab25 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1731360
Jun 01 12:37:40.324000 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3dea67e-a94d-41a2-b6df-b0a897a75c25 req-b43519c2-d843-40c1-9648-48eba6eca208 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1362438
Jun 01 12:37:40.983305 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98c645b-3072-458c-842b-b583a00d1a2d req-6bb8ffa6-aedf-47ee-9966-91b6d4483870 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:40.985392 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a98c645b-3072-458c-842b-b583a00d1a2d req-6bb8ffa6-aedf-47ee-9966-91b6d4483870 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1028955
Jun 01 12:37:41.033054 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a98c645b-3072-458c-842b-b583a00d1a2d req-15bb0482-1d16-4c03-aea6-c1361919bf2c tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417609
Jun 01 12:37:41.300063 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d61046d2-ead3-4c6a-a151-93c1f0fc8249 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:37:41.349195 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: d61046d2-ead3-4c6a-a151-93c1f0fc8249 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:37:41.350134 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d61046d2-ead3-4c6a-a151-93c1f0fc8249 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:37:41.356920 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b6c55d9-c4fe-4aeb-b2e1-1b9779c202ca req-0aed715c-6623-42d9-9772-37ba4f576618 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:41.358480 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0b6c55d9-c4fe-4aeb-b2e1-1b9779c202ca req-0aed715c-6623-42d9-9772-37ba4f576618 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.0937707
Jun 01 12:37:41.409110 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0b6c55d9-c4fe-4aeb-b2e1-1b9779c202ca req-e1b2b758-2034-4988-bba5-62f27b72cbf1 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434883
Jun 01 12:37:42.081039 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:42.236276 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77aa31b5-43e3-4e3b-b85c-46a7430f253d req-d6d8915e-c642-4dac-80fd-41f1e2ab6b77 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:42.238130 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-77aa31b5-43e3-4e3b-b85c-46a7430f253d req-d6d8915e-c642-4dac-80fd-41f1e2ab6b77 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.0874760
Jun 01 12:37:42.295406 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-77aa31b5-43e3-4e3b-b85c-46a7430f253d req-fbfee907-2da4-4a41-903f-8ccf0ae45ac3 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0511873
Jun 01 12:37:42.328656 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:42.598049 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6559d8a9-dfe2-4fcc-a39d-fc70c01381b2 req-eb62a9d0-eba3-49cb-b4d9-dc5f50cbb9ed tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:42.599479 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6559d8a9-dfe2-4fcc-a39d-fc70c01381b2 req-eb62a9d0-eba3-49cb-b4d9-dc5f50cbb9ed tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.0823998
Jun 01 12:37:42.650104 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6559d8a9-dfe2-4fcc-a39d-fc70c01381b2 req-4ee23202-f589-4a34-83fc-1fa9669b823e tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0446990
Jun 01 12:37:42.672669 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-72ac3b63-f596-4fdb-ad3f-5f398f8ec7ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:43.127601 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-2d256db5-2380-4cce-bc70-7aa711593370 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/networks?tenant_id=9dd6c4da99af404092bfb121ac1369ae&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0279918
Jun 01 12:37:43.282059 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-dad32c4b-40cb-4d7c-86e1-b6cc27febbbf tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:43.283499 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-dad32c4b-40cb-4d7c-86e1-b6cc27febbbf tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1491294
Jun 01 12:37:43.299323 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-ad49bd15-885d-4458-a611-b89922ea7330 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/quotas/9dd6c4da99af404092bfb121ac1369ae HTTP/1.1" status: 200  len: 375 time: 0.0097840
Jun 01 12:37:43.350260 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-5727639a-a3ee-4cb4-afb5-a0164065434d tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=9dd6c4da99af404092bfb121ac1369ae&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0450690
Jun 01 12:37:43.531616 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f146cb03-223a-43fd-905a-e09d563112cd req-03a262ce-5ca8-4731-928a-959b8d404043 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:43.539413 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f146cb03-223a-43fd-905a-e09d563112cd req-03a262ce-5ca8-4731-928a-959b8d404043 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1083183
Jun 01 12:37:43.591300 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f146cb03-223a-43fd-905a-e09d563112cd req-60153cf0-f9ed-4a36-bc6a-aa74947e0627 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0511141
Jun 01 12:37:43.701701 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4f3a3df2-9144-44a3-a6e0-1a0c40f4af11 req-6e3e63d1-22ac-4e8f-8daa-329fbb11ffe0 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 210 time: 0.1883357
Jun 01 12:37:43.863552 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:43.903792 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6348726e-14aa-4141-b323-5b61caad0cc6 req-2b8d4178-ce4d-49a4-8a77-7308ed6a0cc5 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:43.905704 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6348726e-14aa-4141-b323-5b61caad0cc6 req-2b8d4178-ce4d-49a4-8a77-7308ed6a0cc5 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.1162231
Jun 01 12:37:43.961393 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6348726e-14aa-4141-b323-5b61caad0cc6 req-4d101961-21cd-47f2-ba84-edf28f66611b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0494936
Jun 01 12:37:44.863916 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9b8a12-1382-46f6-a7ed-ed2ed69a05fd req-4b0f9f34-7034-46e1-8075-263fbe69ac46 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:44.866001 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-4d9b8a12-1382-46f6-a7ed-ed2ed69a05fd req-4b0f9f34-7034-46e1-8075-263fbe69ac46 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Synchronizing usage tracker for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:44.923062 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-911d9b08-afe1-4d0c-bf1e-d7e41b612755 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.95 "GET /v2.0/networks?tenant_id=9dd6c4da99af404092bfb121ac1369ae&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0449245
Jun 01 12:37:44.929970 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-4d9b8a12-1382-46f6-a7ed-ed2ed69a05fd req-4b0f9f34-7034-46e1-8075-263fbe69ac46 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Unset dirty status for tenant:5bf4a909afd242fab0afa824fd49eade on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:44.932021 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d9b8a12-1382-46f6-a7ed-ed2ed69a05fd req-4b0f9f34-7034-46e1-8075-263fbe69ac46 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.2226360
Jun 01 12:37:44.936878 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cd69aaf1-56ad-46c2-b1a9-41a09ae0612e req-f3c05c2d-c952-4d7d-aef6-cc0c5c8d2d8b tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 210 time: 0.0693216
Jun 01 12:37:45.187301 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-93bc114d-c50e-4cb9-8d15-d06d5ac72efe tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:45.190294 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-93bc114d-c50e-4cb9-8d15-d06d5ac72efe tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.95 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.2567799
Jun 01 12:37:45.209540 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Request body: {'port': {'device_id': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c', 'admin_state_up': True, 'tenant_id': '9dd6c4da99af404092bfb121ac1369ae'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:45.222182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d900866-3881-452b-aff6-40257fbe639d req-ed9c6e00-3c14-473e-bbb1-c0166496adee tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:45.224296 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2d900866-3881-452b-aff6-40257fbe639d req-ed9c6e00-3c14-473e-bbb1-c0166496adee tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 944 time: 0.1371701
Jun 01 12:37:45.332938 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 30a14b45-81e5-4718-a910-a6b768fc753f details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:37:45.343298 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2d900866-3881-452b-aff6-40257fbe639d req-6836c68a-756b-42f1-a508-3b67228dca17 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1127996
Jun 01 12:37:45.348670 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d9b8a12-1382-46f6-a7ed-ed2ed69a05fd req-cd114603-35a0-4aae-9d12-37f08ab51095 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3839254
Jun 01 12:37:45.415163 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:45.419432 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Usage tracker for resource:port and tenant:9dd6c4da99af404092bfb121ac1369ae is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:45.423123 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:45.432614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:45.444717 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Made reservation on behalf of 9dd6c4da99af404092bfb121ac1369ae for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:45.448751 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:45.466598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:45.482601 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:45.485679 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:45.491834 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Usage tracker for resource:security_group_rule and tenant:9dd6c4da99af404092bfb121ac1369ae is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:45.495506 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:45.505475 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:45.556602 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 30a14b45-81e5-4718-a910-a6b768fc753f, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=30a14b45-81e5-4718-a910-a6b768fc753f,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:45.577089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '30a14b45-81e5-4718-a910-a6b768fc753f', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'port_id': '30a14b45-81e5-4718-a910-a6b768fc753f', 'mac_address': 'fa:16:3e:43:04:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 759, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:37:45.607546 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:45.612120 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:45.617761 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-899b8fce-ed1c-4e85-be6a-f7165da8403c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:45.644335 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:45.661766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 30a14b45-81e5-4718-a910-a6b768fc753f {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:37:45.679936 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 30a14b45-81e5-4718-a910-a6b768fc753f, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=30a14b45-81e5-4718-a910-a6b768fc753f,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:45.686183 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:45.690436 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-a59a6347-5ed1-43cd-a95e-87462f7cf53c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:45.717712 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Pushing event updated for resources: {'SecurityGroup': ['ID=69c6073d-1679-46d2-8100-4d610a524427,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:45.724464 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:45.780907 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=30a14b45-81e5-4718-a910-a6b768fc753f,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:45.790791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.791148 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.791462 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.792437 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.792437 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.792437 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.792864 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.793078 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.793403 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.793710 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.794056 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.794376 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:37:45.805484 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:45.817540 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Allocated IP 192.168.233.174 (de0cc047-8e57-4f38-85b9-53559146774c/964bc736-63b8-4385-b8d7-02191bbd7adb/088b6c92-39bc-4290-a691-b6c3320d5f73) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:46.004022 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['30a14b45-81e5-4718-a910-a6b768fc753f'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:37:46.122566 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a953541b-9810-4b93-90dc-c25faa56f430 req-6e50910f-e2bf-45ad-b96b-3271c7e16b82 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 210 time: 0.0564477
Jun 01 12:37:46.146258 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:46.165359 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Transition to ACTIVE for port object 088b6c92-39bc-4290-a691-b6c3320d5f73 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:46.200487 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:46.212949 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:46.293770 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Network de0cc047-8e57-4f38-85b9-53559146774c is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:46.295162 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:46.299719 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:46.339250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Pushing event updated for resources: {'Port': ['ID=088b6c92-39bc-4290-a691-b6c3320d5f73,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:46.353667 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:46.383759 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:46.385283 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:46.427740 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 938 time: 1.2215896
Jun 01 12:37:46.442518 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Request body: {'port': {'device_id': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:46.548919 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-09424b07-e3a6-4075-9ec9-3a857954495a None None] Provisioning for port 088b6c92-39bc-4290-a691-b6c3320d5f73 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:46.557982 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-09424b07-e3a6-4075-9ec9-3a857954495a None None] Provisioning complete for port 088b6c92-39bc-4290-a691-b6c3320d5f73 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:46.558367 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-09424b07-e3a6-4075-9ec9-3a857954495a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:46.650385 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-09424b07-e3a6-4075-9ec9-3a857954495a None None] Port 088b6c92-39bc-4290-a691-b6c3320d5f73 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:37:46.705121 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:46.720150 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7c681d-5a90-418f-9605-c9ccf0c8bf90 req-efd27018-d5a2-4187-89ff-0c8773845108 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:46.721706 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4f7c681d-5a90-418f-9605-c9ccf0c8bf90 req-efd27018-d5a2-4187-89ff-0c8773845108 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1044338
Jun 01 12:37:46.796728 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4f7c681d-5a90-418f-9605-c9ccf0c8bf90 req-ae83d9b7-da75-4e10-ae78-cbd6e8c5aa00 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0608461
Jun 01 12:37:46.801999 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3dc332-1f1e-4e46-be75-934997fc3f2f req-6281922d-4f5e-4f84-80f9-21ecbd80ed26 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:46.802718 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-3a3dc332-1f1e-4e46-be75-934997fc3f2f req-6281922d-4f5e-4f84-80f9-21ecbd80ed26 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:46.875665 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-3a3dc332-1f1e-4e46-be75-934997fc3f2f req-6281922d-4f5e-4f84-80f9-21ecbd80ed26 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:46.876842 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a3dc332-1f1e-4e46-be75-934997fc3f2f req-6281922d-4f5e-4f84-80f9-21ecbd80ed26 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 945 time: 0.2530289
Jun 01 12:37:47.005855 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3a3dc332-1f1e-4e46-be75-934997fc3f2f req-50179631-97aa-4a7d-9b80-6fd041648af7 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1202254
Jun 01 12:37:47.236254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 088b6c92-39bc-4290-a691-b6c3320d5f73 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:37:47.253398 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:47.273500 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Transition to ACTIVE for port object 088b6c92-39bc-4290-a691-b6c3320d5f73 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:47.280165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:47.288437 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7992f5c9-82cc-450f-88a4-97dd9760b08b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:47.349800 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 30a14b45-81e5-4718-a910-a6b768fc753f up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:47.367054 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705468a4-e64a-43cf-97da-95d1f995ae44 req-824119cd-0d18-458d-b8a1-3874da17224d tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:47.369285 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-705468a4-e64a-43cf-97da-95d1f995ae44 req-824119cd-0d18-458d-b8a1-3874da17224d tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 948 time: 0.1159005
Jun 01 12:37:47.466138 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-705468a4-e64a-43cf-97da-95d1f995ae44 req-b41ac935-2aa3-4dbd-9414-0c22fb663dd1 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0893455
Jun 01 12:37:47.488222 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 30a14b45-81e5-4718-a910-a6b768fc753f completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:47.495780 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 30a14b45-81e5-4718-a910-a6b768fc753f triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:47.496160 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:47.582090 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Pushing event updated for resources: {'Port': ['ID=088b6c92-39bc-4290-a691-b6c3320d5f73,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:47.591677 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-ce7d343a-9e63-4441-9f02-fffab139a001 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:47.593241 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-ce7d343a-9e63-4441-9f02-fffab139a001 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.4260635
Jun 01 12:37:47.619699 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.331s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:47.656764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:47.692738 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:47.695937 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c83e623-ac6f-4669-b6bb-c5c46e49d086" -d '{"events": [{"server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "name": "network-vif-plugged", "status": "completed", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:47.704592 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 30a14b45-81e5-4718-a910-a6b768fc753f, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=30a14b45-81e5-4718-a910-a6b768fc753f,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:47.724412 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:47.727275 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:47.789386 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38b27fd3-7ffc-459f-a665-25e8b0d4c730 x-openstack-request-id: req-38b27fd3-7ffc-459f-a665-25e8b0d4c730 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:47.789607 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "name": "network-vif-plugged", "status": "completed", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:47.789838 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-38b27fd3-7ffc-459f-a665-25e8b0d4c730 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:47.790216 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f', 'code': 200}
Jun 01 12:37:47.834197 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=30a14b45-81e5-4718-a910-a6b768fc753f,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:47.837693 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:47.866532 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Attempting to bind port 088b6c92-39bc-4290-a691-b6c3320d5f73 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:47.866867 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Attempting to bind port 088b6c92-39bc-4290-a691-b6c3320d5f73 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:47.869231 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Attempting to bind port 088b6c92-39bc-4290-a691-b6c3320d5f73 on network de0cc047-8e57-4f38-85b9-53559146774c {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:47.886147 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Port 088b6c92-39bc-4290-a691-b6c3320d5f73 on network de0cc047-8e57-4f38-85b9-53559146774c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:37:47.886472 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Attempting to bind port 088b6c92-39bc-4290-a691-b6c3320d5f73 on network de0cc047-8e57-4f38-85b9-53559146774c {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:47.894999 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:47.895531 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Checking segment: {'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:47.895765 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Bound using segment: {'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:47.896147 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Bound port: 088b6c92-39bc-4290-a691-b6c3320d5f73, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '09292cec-f1f4-42eb-9348-a59d2b14621d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 755, 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:47.896492 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:47.987643 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Deleting port c612c626-62cb-4f01-863c-58dbaf411409 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:37:47.987985 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:48.070173 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60fbbca5-3b58-4400-852f-969d6645d3e8 req-db00b7a8-0d7e-48bf-a874-19866f435923 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:48.079736 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-60fbbca5-3b58-4400-852f-969d6645d3e8 req-db00b7a8-0d7e-48bf-a874-19866f435923 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 946 time: 0.1430023
Jun 01 12:37:48.182562 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] For port 088b6c92-39bc-4290-a691-b6c3320d5f73, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:48.204194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] For port 088b6c92-39bc-4290-a691-b6c3320d5f73, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=088b6c92-39bc-4290-a691-b6c3320d5f73,segment=NetworkSegment(09292cec-f1f4-42eb-9348-a59d2b14621d),segment_id=09292cec-f1f4-42eb-9348-a59d2b14621d)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:48.207887 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-60fbbca5-3b58-4400-852f-969d6645d3e8 req-218aaf3b-aa3e-42ef-bf2b-92f005536b73 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/security-groups?id=3b2f9524-815b-4333-9acd-f83c8b50e6a5&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1267943
Jun 01 12:37:48.246712 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-688692e9-4525-47bb-ad1f-6a4a87b27854 req-56390a39-8185-458e-9b6e-03750f97daa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:48.248530 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-688692e9-4525-47bb-ad1f-6a4a87b27854 req-56390a39-8185-458e-9b6e-03750f97daa4 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 1099 time: 0.1511743
Jun 01 12:37:48.250862 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:48.262519 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3fd908ab-aaf1-4993-9717-cff9e73c29dc tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:48.307013 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-688692e9-4525-47bb-ad1f-6a4a87b27854 req-10e679f4-d7ef-4820-87e1-2731c038864f service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0463932
Jun 01 12:37:48.336986 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] For port c612c626-62cb-4f01-863c-58dbaf411409, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=c612c626-62cb-4f01-863c-58dbaf411409,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:48.337403 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:48.363453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:48.364066 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:48.365472 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] 10.222.0.95 "PUT /v2.0/ports/088b6c92-39bc-4290-a691-b6c3320d5f73 HTTP/1.1" status: 200  len: 1098 time: 1.9299569
Jun 01 12:37:48.367758 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'tag': '088b6c92-39bc-4290-a691-b6c3320d5f73'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:48.369862 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5" -d '{"events": [{"name": "network-changed", "server_uuid": "de63ad1a-a1c3-4748-8e71-b6021574aeb7", "tag": "088b6c92-39bc-4290-a691-b6c3320d5f73"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:48.616045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3869f8c-8ff8-4df2-9bb2-3db63440a7d5 x-openstack-request-id: req-d3869f8c-8ff8-4df2-9bb2-3db63440a7d5 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:48.616366 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "de63ad1a-a1c3-4748-8e71-b6021574aeb7", "tag": "088b6c92-39bc-4290-a691-b6c3320d5f73", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:48.616671 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-d3869f8c-8ff8-4df2-9bb2-3db63440a7d5 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:48.617092 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'tag': '088b6c92-39bc-4290-a691-b6c3320d5f73', 'status': 'completed', 'code': 200}
Jun 01 12:37:48.624612 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Calling delete_port for c612c626-62cb-4f01-863c-58dbaf411409 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:37:48.646237 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Pushing event updated for resources: {'Port': ['ID=088b6c92-39bc-4290-a691-b6c3320d5f73,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:48.653106 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.390s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:48.697609 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6bcb75-f18f-4268-9848-e4b76e19ca68 req-4f598a6b-eccd-49e6-a7be-ad6bed77ca93 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:48.699378 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4f6bcb75-f18f-4268-9848-e4b76e19ca68 req-4f598a6b-eccd-49e6-a7be-ad6bed77ca93 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.4939101
Jun 01 12:37:48.737673 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ee279e-73c0-4d88-80cc-10ecf62a42a7 req-5d73226a-95e5-41a7-bab4-ae41364b2f7f tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:48.739420 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85ee279e-73c0-4d88-80cc-10ecf62a42a7 req-5d73226a-95e5-41a7-bab4-ae41364b2f7f tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 948 time: 0.1059258
Jun 01 12:37:48.755219 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-6a088647-7789-4c86-bc94-ecfda5e0132a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:48.756737 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-6a088647-7789-4c86-bc94-ecfda5e0132a service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=9dd6c4da99af404092bfb121ac1369ae&device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 1101 time: 0.1792359
Jun 01 12:37:48.792442 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85ee279e-73c0-4d88-80cc-10ecf62a42a7 req-8686d5d9-63f7-4cdf-9db6-a09fdfd5666a tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0460749
Jun 01 12:37:48.824236 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4f6bcb75-f18f-4268-9848-e4b76e19ca68 req-0f0d534c-c6f5-4839-b244-46ffc1fcbcd5 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1175086
Jun 01 12:37:48.837462 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-25dd7399-d489-4dc2-8fcb-6d20ca7ad33b service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.174&port_id=088b6c92-39bc-4290-a691-b6c3320d5f73 HTTP/1.1" status: 200  len: 217 time: 0.0709269
Jun 01 12:37:48.992863 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-e08030e1-17f7-465a-879d-8317bae12676 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:48.994920 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-e08030e1-17f7-465a-879d-8317bae12676 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=964bc736-63b8-4385-b8d7-02191bbd7adb HTTP/1.1" status: 200  len: 843 time: 0.1467559
Jun 01 12:37:49.001118 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:49.008087 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:49.026764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['c612c626-62cb-4f01-863c-58dbaf411409'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:37:49.128355 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Pushing event deleted for resources: {'Port': ['ID=c612c626-62cb-4f01-863c-58dbaf411409,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:49.133468 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:49.251791 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] No DVR routers for this DVR port c612c626-62cb-4f01-863c-58dbaf411409 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:37:49.277714 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:49.304556 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3f7fe1d6-31de-4c36-8917-f9432b8e2182 req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.95 "DELETE /v2.0/ports/c612c626-62cb-4f01-863c-58dbaf411409 HTTP/1.1" status: 204  len: 173 time: 1.6838284
Jun 01 12:37:49.310152 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-8adb6af9-90ac-40b4-90e0-7a254c8ed86d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:49.311689 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-8adb6af9-90ac-40b4-90e0-7a254c8ed86d service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=de0cc047-8e57-4f38-85b9-53559146774c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.2625184
Jun 01 12:37:49.459927 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b4349e04-e13f-4717-ae48-f64cb0e20c07 req-6ca66cd1-716f-4436-8ec3-9baf92876438 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] 10.222.0.81 "GET /v2.0/ports?device_id=9667206d-ce8b-4b7f-bacb-a9e2fed82b66 HTTP/1.1" status: 200  len: 210 time: 0.0668728
Jun 01 12:37:49.522169 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-42c65f5e-f433-4258-b12d-acd459c55cad service neutron] 10.222.0.95 "GET /v2.0/networks/de0cc047-8e57-4f38-85b9-53559146774c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2015753
Jun 01 12:37:49.816370 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83793559-f2a3-48e5-b6ad-32fd1c38af23 req-63d86461-8ebc-441e-b1b8-2e53fa771887 service neutron] 10.222.0.95 "GET /v2.0/networks/de0cc047-8e57-4f38-85b9-53559146774c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2840459
Jun 01 12:37:50.121192 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca8aedb2-41b6-49af-9892-7b42f79cf911 req-38603d31-2de5-4ac0-ac73-3ac35f99228c tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:50.122880 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca8aedb2-41b6-49af-9892-7b42f79cf911 req-38603d31-2de5-4ac0-ac73-3ac35f99228c tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.1254849
Jun 01 12:37:50.152124 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5425a9f-5502-4a63-921f-50226161756a req-8ff8b91a-dcfc-45b7-a59f-cc10802923ea tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:50.152946 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-f5425a9f-5502-4a63-921f-50226161756a req-8ff8b91a-dcfc-45b7-a59f-cc10802923ea tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Synchronizing usage tracker for tenant:9dd6c4da99af404092bfb121ac1369ae on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:50.164014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-baf4dd27-ca37-49d4-a152-b7ffbf851037 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:50.165947 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-baf4dd27-ca37-49d4-a152-b7ffbf851037 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=9dd6c4da99af404092bfb121ac1369ae&device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 1101 time: 0.1956584
Jun 01 12:37:50.209274 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ca8aedb2-41b6-49af-9892-7b42f79cf911 req-651b2da5-b081-48d7-99d2-a24a2fae2fbc tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0732284
Jun 01 12:37:50.264227 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-f5425a9f-5502-4a63-921f-50226161756a req-8ff8b91a-dcfc-45b7-a59f-cc10802923ea tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Unset dirty status for tenant:9dd6c4da99af404092bfb121ac1369ae on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:50.265440 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f5425a9f-5502-4a63-921f-50226161756a req-8ff8b91a-dcfc-45b7-a59f-cc10802923ea tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 948 time: 0.2437992
Jun 01 12:37:50.333338 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-f5425a9f-5502-4a63-921f-50226161756a req-847680c6-5de4-47a8-b7cc-172222aac728 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Synchronizing usage tracker for tenant:9dd6c4da99af404092bfb121ac1369ae on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:50.396892 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-185e2a01-bd87-4441-8ad9-a15445727932 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:50.398418 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-185e2a01-bd87-4441-8ad9-a15445727932 service neutron] 10.222.0.95 "GET /v2.0/networks?id=de0cc047-8e57-4f38-85b9-53559146774c HTTP/1.1" status: 200  len: 870 time: 0.2241001
Jun 01 12:37:50.399621 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-f5425a9f-5502-4a63-921f-50226161756a req-847680c6-5de4-47a8-b7cc-172222aac728 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Unset dirty status for tenant:9dd6c4da99af404092bfb121ac1369ae on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:50.400661 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f5425a9f-5502-4a63-921f-50226161756a req-847680c6-5de4-47a8-b7cc-172222aac728 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1267722
Jun 01 12:37:50.456761 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5cee18-6e13-4c87-9807-8cdd1b69b2e0 req-13fc1355-d1ec-48b9-9e37-9fefec18e799 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:50.458277 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ec5cee18-6e13-4c87-9807-8cdd1b69b2e0 req-13fc1355-d1ec-48b9-9e37-9fefec18e799 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.1280966
Jun 01 12:37:50.472806 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-9ec06a96-99a1-47fc-9592-44a9bfe8c61d service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.174&port_id=088b6c92-39bc-4290-a691-b6c3320d5f73 HTTP/1.1" status: 200  len: 217 time: 0.0661521
Jun 01 12:37:50.516789 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ec5cee18-6e13-4c87-9807-8cdd1b69b2e0 req-54878b46-f9bd-4252-865b-444a25818c5f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0506413
Jun 01 12:37:50.547037 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-d731895c-6d5a-43ce-8361-a1eadf676199 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:50.547429 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60652) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:50.547611 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-d731895c-6d5a-43ce-8361-a1eadf676199 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=964bc736-63b8-4385-b8d7-02191bbd7adb HTTP/1.1" status: 200  len: 843 time: 0.0676837
Jun 01 12:37:50.599465 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60658) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:50.618640 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'name': 'network-vif-deleted', 'tag': 'c612c626-62cb-4f01-863c-58dbaf411409'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:50.621103 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ce769ab-263d-45c7-82ec-1475f66681be" -d '{"events": [{"server_uuid": "9667206d-ce8b-4b7f-bacb-a9e2fed82b66", "name": "network-vif-deleted", "tag": "c612c626-62cb-4f01-863c-58dbaf411409"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:50.686560 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-a891b374-0c92-4803-911f-ca2f5098b3cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:50.691187 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-a891b374-0c92-4803-911f-ca2f5098b3cd service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=de0cc047-8e57-4f38-85b9-53559146774c&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.1295052
Jun 01 12:37:50.697595 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-644f126b-5a7e-4015-8c08-61b93d11ccb8 x-openstack-request-id: req-644f126b-5a7e-4015-8c08-61b93d11ccb8 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:50.698236 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9667206d-ce8b-4b7f-bacb-a9e2fed82b66", "name": "network-vif-deleted", "tag": "c612c626-62cb-4f01-863c-58dbaf411409", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:50.698930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-644f126b-5a7e-4015-8c08-61b93d11ccb8 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:50.699624 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9667206d-ce8b-4b7f-bacb-a9e2fed82b66', 'name': 'network-vif-deleted', 'tag': 'c612c626-62cb-4f01-863c-58dbaf411409', 'status': 'completed', 'code': 200}
Jun 01 12:37:50.863471 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-69a311c7-7c71-4b04-987e-4c5c40b66e3a service neutron] 10.222.0.95 "GET /v2.0/networks/de0cc047-8e57-4f38-85b9-53559146774c?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1604137
Jun 01 12:37:51.052622 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee6e4ef6-b810-4e26-a703-68ee0ad40ed5 req-73d58366-485f-4221-bf5c-aaddc36203e8 service neutron] 10.222.0.95 "GET /v2.0/networks/de0cc047-8e57-4f38-85b9-53559146774c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1810393
Jun 01 12:37:51.137761 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd706312-1b21-435b-904b-9b637e98145d tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:51.140549 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-bd706312-1b21-435b-904b-9b637e98145d tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] Synchronizing usage tracker for tenant:bcdfacaebc2c46cb92fbb72bc2498b24 on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:51.170446 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-63762452-6321-4168-918c-cca7635e6f48 req-c53b0eeb-7800-477a-a87d-5f10eaf781a5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Synchronizing usage tracker for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:51.189448 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-63762452-6321-4168-918c-cca7635e6f48 req-c53b0eeb-7800-477a-a87d-5f10eaf781a5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Unset dirty status for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:51.190754 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-c53b0eeb-7800-477a-a87d-5f10eaf781a5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-737028728&fields=id&tenant_id=a4d9bab00fe345e0b899bc42ea4416e0 HTTP/1.1" status: 200  len: 267 time: 0.0662143
Jun 01 12:37:51.202885 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-bd706312-1b21-435b-904b-9b637e98145d tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] Unset dirty status for tenant:bcdfacaebc2c46cb92fbb72bc2498b24 on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:51.204007 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bd706312-1b21-435b-904b-9b637e98145d tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 1094 time: 0.6556032
Jun 01 12:37:51.208858 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60680) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:51.213535 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'port_id': '30a14b45-81e5-4718-a910-a6b768fc753f', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address': '172.20.0.12'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:51.226805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:51.233477 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:floatingip and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:51.238244 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:51.246333 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:51.302700 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:51.348240 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-95419b8a-6cf8-4406-9d74-f1f696a046dc tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:51.349825 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-95419b8a-6cf8-4406-9d74-f1f696a046dc tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 806 time: 0.1519186
Jun 01 12:37:51.366674 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-2648053e-a51b-4b76-ad77-129a577a61b4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/quotas/a4d9bab00fe345e0b899bc42ea4416e0 HTTP/1.1" status: 200  len: 375 time: 0.0097375
Jun 01 12:37:51.373504 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device c612c626-62cb-4f01-863c-58dbaf411409 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:37:51.408769 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: c612c626-62cb-4f01-863c-58dbaf411409 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:37:51.409146 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device c612c626-62cb-4f01-863c-58dbaf411409 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:37:51.480113 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-2d51fa1a-0019-45cc-8135-243cc3228863 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&fields=id HTTP/1.1" status: 200  len: 302 time: 0.1073525
Jun 01 12:37:51.616117 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-0b4b96a1-455a-4c63-86ed-530fff7f30e0 service neutron] 10.222.0.81 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1350012
Jun 01 12:37:51.665241 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:51.669125 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:51.747563 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-a1fa182d-e92b-4223-918c-65928372a859 service neutron] 10.222.0.81 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1254652
Jun 01 12:37:51.787219 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4c48f4-b802-4f6e-aeb0-863f2c197796 req-e47453bd-2019-4442-bb11-16a6b04246d0 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:51.788671 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8c4c48f4-b802-4f6e-aeb0-863f2c197796 req-e47453bd-2019-4442-bb11-16a6b04246d0 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 948 time: 0.2408414
Jun 01 12:37:51.987477 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8c4c48f4-b802-4f6e-aeb0-863f2c197796 req-327c43a0-2d60-40e3-a55b-6d096b11c911 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1896412
Jun 01 12:37:52.103197 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Allocated IP 172.27.3.172 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/9d555299-8581-40e5-b057-06221c7a592c) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:52.167159 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-b16a1e7e-6424-41b1-a8ca-0d234dccd1e6 req-f731c5fa-86b0-4e6e-b32a-2d0544a929d8 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Synchronizing usage tracker for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:52.270578 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-b16a1e7e-6424-41b1-a8ca-0d234dccd1e6 req-f731c5fa-86b0-4e6e-b32a-2d0544a929d8 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Unset dirty status for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:52.271878 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b16a1e7e-6424-41b1-a8ca-0d234dccd1e6 req-f731c5fa-86b0-4e6e-b32a-2d0544a929d8 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 210 time: 0.1578333
Jun 01 12:37:52.401093 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:52.459376 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Deleting port bcc33710-f3d9-4f03-8973-7059a54c1e11 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:37:52.459736 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:52.479049 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:52.531158 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:52.604133 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:52.608444 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:52.615515 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:52.675181 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=9d555299-8581-40e5-b057-06221c7a592c,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:52.683294 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:52.708493 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] For port bcc33710-f3d9-4f03-8973-7059a54c1e11, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=bcc33710-f3d9-4f03-8973-7059a54c1e11,segment=NetworkSegment(1396a8b0-159e-40ec-9e21-d81bb2064dbc),segment_id=1396a8b0-159e-40ec-9e21-d81bb2064dbc)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:52.708877 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:52.875769 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Calling delete_port for bcc33710-f3d9-4f03-8973-7059a54c1e11 owned by network:router_interface {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:37:53.380721 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 088b6c92-39bc-4290-a691-b6c3320d5f73 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:37:53.488278 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7bca2b3-6dc8-4732-b039-346d28a8438e req-1e9a5e43-32d8-4a00-bdb3-9077ea2d2b06 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:53.490603 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7bca2b3-6dc8-4732-b039-346d28a8438e req-1e9a5e43-32d8-4a00-bdb3-9077ea2d2b06 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 948 time: 0.3708045
Jun 01 12:37:53.510704 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-dff86e98-fccc-487d-be51-0b1647602f66 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:53.512409 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-dff86e98-fccc-487d-be51-0b1647602f66 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.95 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 806 time: 0.3340819
Jun 01 12:37:53.601670 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7bca2b3-6dc8-4732-b039-346d28a8438e req-1e8911d2-e2ad-4d01-bd0b-0791b7853832 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0994289
Jun 01 12:37:53.612033 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-e30d8bba-ade0-4566-9c46-963e99acc6b1 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a4d9bab00fe345e0b899bc42ea4416e0 HTTP/1.1" status: 200  len: 379 time: 0.0849032
Jun 01 12:37:53.613112 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b101294f-ed29-425f-8a08-3351d8ba7c4c req-33542a56-cc0b-41ba-98a4-621b232eb8d5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 210 time: 0.0849819
Jun 01 12:37:53.622736 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'port': {'device_id': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'admin_state_up': True, 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'security_groups': ['769d56f0-3abb-4565-bb76-1e82a3f776a4']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:53.627585 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 088b6c92-39bc-4290-a691-b6c3320d5f73, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=088b6c92-39bc-4290-a691-b6c3320d5f73,segment=NetworkSegment(09292cec-f1f4-42eb-9348-a59d2b14621d),segment_id=09292cec-f1f4-42eb-9348-a59d2b14621d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:53.643650 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '088b6c92-39bc-4290-a691-b6c3320d5f73', 'network_id': 'de0cc047-8e57-4f38-85b9-53559146774c', 'port_id': '088b6c92-39bc-4290-a691-b6c3320d5f73', 'mac_address': 'fa:16:3e:f7:d9:f3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 755, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '964bc736-63b8-4385-b8d7-02191bbd7adb', 'ip_address': '192.168.233.174'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:37:53.709753 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:53.734546 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:53.741236 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:53.741881 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 088b6c92-39bc-4290-a691-b6c3320d5f73 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:37:53.760956 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 088b6c92-39bc-4290-a691-b6c3320d5f73, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=088b6c92-39bc-4290-a691-b6c3320d5f73,segment=NetworkSegment(09292cec-f1f4-42eb-9348-a59d2b14621d),segment_id=09292cec-f1f4-42eb-9348-a59d2b14621d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:53.765962 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:53.768552 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-5690750a-5024-41ba-ada7-7a0430b4b284 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:53.819707 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:53.831241 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:53.841803 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Made reservation on behalf of a4d9bab00fe345e0b899bc42ea4416e0 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:53.845036 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=088b6c92-39bc-4290-a691-b6c3320d5f73,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:53.846254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:53.848221 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:53.928239 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Pushing event deleted for resources: {'Port': ['ID=bcc33710-f3d9-4f03-8973-7059a54c1e11,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:53.963559 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:54.013104 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['088b6c92-39bc-4290-a691-b6c3320d5f73'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:37:54.016775 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Allocated IP 172.20.0.4 (8c58f5e9-2554-475d-a254-a02b35fda51b/167cc367-6630-45a8-93ac-09106b9e41f1/db567b77-bbc1-4e8f-95eb-46817c3ec9d6) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:37:54.143334 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.225679 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.243803 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Transition to ACTIVE for port object db567b77-bbc1-4e8f-95eb-46817c3ec9d6 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:54.269187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.275170 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-08aa293f-3958-49da-9a92-254ea1144e75 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:54.342073 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Network 8c58f5e9-2554-475d-a254-a02b35fda51b is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:37:54.345498 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:37:54.349632 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:37:54.404723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:54.409867 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:54.429321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:54.430063 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.445012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.463706 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.473341 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8545771
Jun 01 12:37:54.488005 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Request body: {'port': {'device_id': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:54.604854 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.640982 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-06fd6286-4ede-4abf-a5d6-509a8898bd31 None None] Provisioning for port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:54.647689 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-06fd6286-4ede-4abf-a5d6-509a8898bd31 None None] Provisioning complete for port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:54.648563 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-06fd6286-4ede-4abf-a5d6-509a8898bd31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:54.727737 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-06fd6286-4ede-4abf-a5d6-509a8898bd31 None None] Port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:37:54.841750 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60780) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:54.996051 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d0c505-f5da-4c10-a1de-525bc795dc65 req-393f956b-cb21-4d3e-b6b3-a4a457eade43 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:54.997538 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c0d0c505-f5da-4c10-a1de-525bc795dc65 req-393f956b-cb21-4d3e-b6b3-a4a457eade43 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 949 time: 0.1963267
Jun 01 12:37:55.092642 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Deleting subnet 0c11cd35-b97b-4949-aaa4-6eb3505216f7 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:37:55.100641 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c0d0c505-f5da-4c10-a1de-525bc795dc65 req-b27890c6-af5b-40d5-bab1-d9c292fe9c2e tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0899599
Jun 01 12:37:55.102346 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.102544 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id db567b77-bbc1-4e8f-95eb-46817c3ec9d6 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:37:55.110563 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.131805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Transition to ACTIVE for port object db567b77-bbc1-4e8f-95eb-46817c3ec9d6 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:37:55.131805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.133841 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:55.172051 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.185176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.192325 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:55.238743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.282789 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:55.285047 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7174d11-68fe-437c-9171-805aac70e5c1 req-41a33388-c863-44fa-81d2-0b8a302227bc tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:55.291270 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:55.291510 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c7174d11-68fe-437c-9171-805aac70e5c1 req-41a33388-c863-44fa-81d2-0b8a302227bc tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 931 time: 0.4527352
Jun 01 12:37:55.303971 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:37:55.371751 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Attempting to bind port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:37:55.372077 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Attempting to bind port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:37:55.372399 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Attempting to bind port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 on network 8c58f5e9-2554-475d-a254-a02b35fda51b {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:55.377232 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 on network 8c58f5e9-2554-475d-a254-a02b35fda51b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:37:55.377627 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Attempting to bind port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 on network 8c58f5e9-2554-475d-a254-a02b35fda51b {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:37:55.382777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:37:55.383108 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Checking segment: {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:37:55.383488 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Bound using segment: {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:37:55.383928 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Bound port: db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cf66ca3e-849f-4c7a-ac26-44c6330098be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 792, 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:37:55.384242 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.388688 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 088b6c92-39bc-4290-a691-b6c3320d5f73 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:37:55.408890 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=9d555299-8581-40e5-b057-06221c7a592c,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:55.473466 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 088b6c92-39bc-4290-a691-b6c3320d5f73 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:37:55.479624 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 088b6c92-39bc-4290-a691-b6c3320d5f73 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:37:55.480152 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:55.480594 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.497240 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.526820 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-c7174d11-68fe-437c-9171-805aac70e5c1 req-79bc1382-f303-4e9e-9d70-5eb20a582535 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Synchronizing usage tracker for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:55.555378 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.576561 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:37:55.580363 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:37:55.584982 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.588723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:55.630813 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.652023 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:55.652685 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.654041 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] 10.222.0.95 "PUT /v2.0/ports/db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 1093 time: 1.1712465
Jun 01 12:37:55.654686 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:55.656696 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-c7174d11-68fe-437c-9171-805aac70e5c1 req-79bc1382-f303-4e9e-9d70-5eb20a582535 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Unset dirty status for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:55.657834 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c7174d11-68fe-437c-9171-805aac70e5c1 req-79bc1382-f303-4e9e-9d70-5eb20a582535 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3653717
Jun 01 12:37:55.658164 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1" -d '{"events": [{"name": "network-changed", "server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:55.690350 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '088b6c92-39bc-4290-a691-b6c3320d5f73'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:55.692913 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db1964c0-0945-4b9e-b903-b2d3b3da67ae" -d '{"events": [{"server_uuid": "de63ad1a-a1c3-4748-8e71-b6021574aeb7", "name": "network-vif-plugged", "status": "completed", "tag": "088b6c92-39bc-4290-a691-b6c3320d5f73"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:55.714843 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 088b6c92-39bc-4290-a691-b6c3320d5f73, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=088b6c92-39bc-4290-a691-b6c3320d5f73,segment=NetworkSegment(09292cec-f1f4-42eb-9348-a59d2b14621d),segment_id=09292cec-f1f4-42eb-9348-a59d2b14621d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:55.729889 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:55.731860 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-d466a193-e3a8-4dc0-8766-749c696ac58f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:55.759025 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f6ffa22-c57f-4ca9-a34b-a80c08e71347 x-openstack-request-id: req-9f6ffa22-c57f-4ca9-a34b-a80c08e71347 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:55.759498 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:55.759867 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-9f6ffa22-c57f-4ca9-a34b-a80c08e71347 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:55.760533 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'status': 'completed', 'code': 200}
Jun 01 12:37:55.765375 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:55.774958 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:55.804474 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4da2f70-2966-4c33-b062-c9a26739933b x-openstack-request-id: req-d4da2f70-2966-4c33-b062-c9a26739933b {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:55.805144 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de63ad1a-a1c3-4748-8e71-b6021574aeb7", "name": "network-vif-plugged", "status": "completed", "tag": "088b6c92-39bc-4290-a691-b6c3320d5f73", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:55.805545 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-d4da2f70-2966-4c33-b062-c9a26739933b {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:55.806073 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '088b6c92-39bc-4290-a691-b6c3320d5f73', 'code': 200}
Jun 01 12:37:55.825597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-62cde395-496b-4ba2-9313-a3b869e5b5fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:55.827923 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-62cde395-496b-4ba2-9313-a3b869e5b5fb service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1096 time: 0.1134589
Jun 01 12:37:55.841332 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=088b6c92-39bc-4290-a691-b6c3320d5f73,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:55.844790 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:55.918773 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-b72b8efa-1435-44c2-93c4-11d4429f4427 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 217 time: 0.0741520
Jun 01 12:37:56.025066 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-f021ff7b-e94c-4779-ba35-22ed7aabc37c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:56.026461 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-f021ff7b-e94c-4779-ba35-22ed7aabc37c service neutron] 10.222.0.95 "GET /v2.0/subnets?id=167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 200  len: 845 time: 0.1014605
Jun 01 12:37:56.083182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:37:56.092594 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] Sync routers for ids ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:37:56.102798 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.l3_db [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Floating IP d2d1bbc3-bbff-4db5-abd1-679398f8f782 associated. External IP: 172.27.3.172, port: 30a14b45-81e5-4718-a910-a6b768fc753f.
Jun 01 12:37:56.103449 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] Routers {'4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:56.104129 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6580>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:56.130797 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7003c36-72de-465a-bcae-6f6add23aa93 req-b062dbd2-ef61-4524-aac9-8436634b4453 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:56.132249 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f7003c36-72de-465a-bcae-6f6add23aa93 req-b062dbd2-ef61-4524-aac9-8436634b4453 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 1103 time: 0.1422319
Jun 01 12:37:56.137782 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63762452-6321-4168-918c-cca7635e6f48 req-c4286ed4-754e-4e66-bb86-66f1c18d05d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:56.139727 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-c4286ed4-754e-4e66-bb86-66f1c18d05d8 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=8c58f5e9-2554-475d-a254-a02b35fda51b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1024935
Jun 01 12:37:56.187153 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f7003c36-72de-465a-bcae-6f6add23aa93 req-5fe75748-c3cd-4940-8dc1-698012e8310a service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455337
Jun 01 12:37:56.222501 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] 10.222.0.81 "PUT /v2.0/routers/4cc34e86-2aec-44cb-a4d3-797d45bd3d9b/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 5.6198084
Jun 01 12:37:56.231256 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60790) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:56.323432 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] Set router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:56.391436 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-baf188f8-53dd-41ac-8433-75da1bd8cbfa service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2068365
Jun 01 12:37:56.433294 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db0c048-8fc8-4750-86b7-b615820c7557 req-4034dc1a-d415-4784-a808-d27a948d32f0 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:56.440175 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4db0c048-8fc8-4750-86b7-b615820c7557 req-4034dc1a-d415-4784-a808-d27a948d32f0 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 950 time: 0.1665552
Jun 01 12:37:56.553152 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4db0c048-8fc8-4750-86b7-b615820c7557 req-7ffbc623-9475-4d75-8c30-1b7fa9bfc241 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1119509
Jun 01 12:37:56.596803 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-63762452-6321-4168-918c-cca7635e6f48 req-6dff9a8c-2650-4a43-9ed2-95a6f5d6005c service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1949394
Jun 01 12:37:56.615258 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:56.629675 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6580>, [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:37:53Z', 'revision_number': 5, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:56.633562 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] Checking router: 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:37:56.635425 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:56.643751 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] Routers {'4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:56.644380 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6580>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:56.665130 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks [] for router, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:56.722545 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-fa9bf18c-0011-4133-bf29-7aa6bf483e7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:56.724150 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-fa9bf18c-0011-4133-bf29-7aa6bf483e7b service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1096 time: 0.0758886
Jun 01 12:37:56.797430 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0c11cd35-b97b-4949-aaa4-6eb3505216f7,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:56.800007 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:56.802838 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:56.831187 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] Set router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:56.848082 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b513a032-25d5-4039-90ef-259b7f8ef5f7 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/0c11cd35-b97b-4949-aaa4-6eb3505216f7 HTTP/1.1" status: 204  len: 168 time: 2.0036821
Jun 01 12:37:56.853245 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60796) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:56.963395 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-e0ecc576-1c8f-4661-83e3-56557c4e10b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:56.965122 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-e0ecc576-1c8f-4661-83e3-56557c4e10b9 service neutron] 10.222.0.95 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 907 time: 0.2335443
Jun 01 12:37:56.987756 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.015017 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:37:57.058323 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-9ec0f7ae-b780-4b25-9c8d-9679b423b249 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 217 time: 0.0685346
Jun 01 12:37:57.129131 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e08b242-2d5e-4c01-98f0-aa14c71d4802 req-5cb42876-831f-4795-b479-9ebd6186b47a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:57.130779 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3e08b242-2d5e-4c01-98f0-aa14c71d4802 req-5cb42876-831f-4795-b479-9ebd6186b47a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.2979505
Jun 01 12:37:57.150074 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe6580>, [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:37:53Z', 'revision_number': 5, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:57.154190 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a642d98-8e37-43e5-afde-647294e42725 None None] The sync data for ids ['4cc34e86-2aec-44cb-a4d3-797d45bd3d9b'] in dv-cinder-793515-2-iscsi is: [{'id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'name': 'tempest-ServerRescueNegativeTestJSON-1397935000-router', 'tenant_id': '5bf4a909afd242fab0afa824fd49eade', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95'}], 'enable_snat': True}, 'gw_port_id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:37:53Z', 'revision_number': 5, 'project_id': '5bf4a909afd242fab0afa824fd49eade', 'gw_port': {'id': 'd6f1f113-e8d7-469b-a186-85c504c1ea64', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c8:bb:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cc34e86-2aec-44cb-a4d3-797d45bd3d9b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:37:57.181645 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.241578 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.250279 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-11b15a3e-b345-42dd-809e-5c4ef37a56ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:57.251709 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-11b15a3e-b345-42dd-809e-5c4ef37a56ec service neutron] 10.222.0.95 "GET /v2.0/subnets?id=167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 200  len: 845 time: 0.1600013
Jun 01 12:37:57.257782 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a2443b4c0>,) {'filters': {'network_id': ['ad7e28fd-84b8-40b7-949c-94a41a55b4ce']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:57.315758 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3e08b242-2d5e-4c01-98f0-aa14c71d4802 req-2a8c0d56-5b81-4771-8fe6-26a08c0b385f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1652768
Jun 01 12:37:57.366279 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:37:57.378433 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:37:57.393560 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Deleting port d6f1f113-e8d7-469b-a186-85c504c1ea64 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:37:57.394034 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.396030 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:57.396821 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b69dc0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:57.399186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2443b4c0>, '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:57.399478 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2443b4c0>, '1743f99e-0bfd-4a13-a9a5-3c94f99e75ec') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:57.409787 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.420836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.444263 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.453905 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Releasing vlan 775 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:37:57.454329 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:37:57.468765 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:37:57.550556 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-70eb87a8-f19b-47a6-bf04-b401853befe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:57.552200 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-70eb87a8-f19b-47a6-bf04-b401853befe5 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=8c58f5e9-2554-475d-a254-a02b35fda51b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2874570
Jun 01 12:37:57.586991 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.596783 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:57.646336 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:57.665914 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.682910 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Pushing event deleted for resources: {'Network': ['ID=ad7e28fd-84b8-40b7-949c-94a41a55b4ce,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:57.694254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:57.714539 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] 10.222.0.81 "DELETE /v2.0/networks/ad7e28fd-84b8-40b7-949c-94a41a55b4ce HTTP/1.1" status: 204  len: 168 time: 0.8602657
Jun 01 12:37:57.725119 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 6.5154605
Jun 01 12:37:57.738470 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f'}] {{(pid=91978) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:37:57.741458 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08332f069cdff5b13479b061d6bbe376049db186f7bff4c04e61a4b86035db55" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2dbf137b-213d-4e86-bb72-c30a6313dfb4" -d '{"events": [{"name": "network-changed", "server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f"}]}' {{(pid=91978) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:37:57.771511 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-5d7fbe28-5725-47e2-a545-e9ba26c74f60 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2086906
Jun 01 12:37:57.814709 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] For port d6f1f113-e8d7-469b-a186-85c504c1ea64, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=d6f1f113-e8d7-469b-a186-85c504c1ea64,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:37:57.815072 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:57.823749 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:37:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e45e8ae-c27b-42a4-9a2d-ef34e305d843 x-openstack-request-id: req-0e45e8ae-c27b-42a4-9a2d-ef34e305d843 {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:37:57.824260 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f", "status": "completed", "code": 200}]} {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:37:57.824731 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-0e45e8ae-c27b-42a4-9a2d-ef34e305d843 {{(pid=91978) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:37:57.825312 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f', 'status': 'completed', 'code': 200}
Jun 01 12:37:57.975814 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Calling delete_port for d6f1f113-e8d7-469b-a186-85c504c1ea64 owned by network:router_gateway {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:37:58.017018 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60808) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:58.042414 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4a6727cb-4cd0-4d31-89f9-d02d5ed928a1 req-ce594a74-949b-4d4d-bc57-16fb4fd6628f service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2139866
Jun 01 12:37:58.052544 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91693c9b-28d7-4343-bbb7-ea6526273b24 req-58aa273b-95a6-4ab1-9ad5-bd5843847d47 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:58.054141 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-91693c9b-28d7-4343-bbb7-ea6526273b24 req-58aa273b-95a6-4ab1-9ad5-bd5843847d47 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 950 time: 0.2816069
Jun 01 12:37:58.105276 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-c9c60482-36d8-4b1f-8b60-1a8b3faab2a3 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=de15817fec1344958f88c8a9b4ad3a81&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0870135
Jun 01 12:37:58.106380 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b69dc0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'd2d1bbc3-bbff-4db5-abd1-679398f8f782', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.172', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '30a14b45-81e5-4718-a910-a6b768fc753f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:43:04:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:37:53Z', 'updated_at': '2021-06-01T12:37:53Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:58.106594 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60812) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:58.111096 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-91693c9b-28d7-4343-bbb7-ea6526273b24 req-53836fb1-4e0e-424d-8f94-d000dd06e8b3 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0480945
Jun 01 12:37:58.113211 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-b8f41232-14e7-4e37-a788-b33705e38f5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:58.114601 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-b8f41232-14e7-4e37-a788-b33705e38f5d service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 1099 time: 0.1478767
Jun 01 12:37:58.117501 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:37:58.134256 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:37:58.136659 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b69dc0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:58.237682 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.265195 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.268793 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-2b2496f2-3a1d-42f9-83ac-0937a4a04bf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:58.270485 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-2b2496f2-3a1d-42f9-83ac-0937a4a04bf6 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1490107
Jun 01 12:37:58.321848 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.328774 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:58.366000 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:37:58.375073 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.391606 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Pushing event deleted for resources: {'Port': ['ID=d6f1f113-e8d7-469b-a186-85c504c1ea64,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:58.482413 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-a71507de-627d-4ab3-b3a3-a24ceae4d4a5 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=30a14b45-81e5-4718-a910-a6b768fc753f HTTP/1.1" status: 200  len: 1000 time: 0.2043684
Jun 01 12:37:58.494922 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:58.498823 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ce6bc6c2-bd62-4c4a-9c86-e7e0be2e09c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.111s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:58.513619 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.613441 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-9f19027a-0436-448e-a58d-9ce961e4c6cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:58.614912 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-9f19027a-0436-448e-a58d-9ce961e4c6cf service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.1228526
Jun 01 12:37:58.681673 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc2fd0c-d6e7-485c-93cb-76580086b371 req-8eeb6d35-ed41-464f-aee8-260ca411bfc5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:58.682362 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-bdc2fd0c-d6e7-485c-93cb-76580086b371 req-8eeb6d35-ed41-464f-aee8-260ca411bfc5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Synchronizing usage tracker for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:37:58.717322 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=618a82d3-59d4-4787-b8c4-7a2c63649640,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:58.717676 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-bdc2fd0c-d6e7-485c-93cb-76580086b371 req-8eeb6d35-ed41-464f-aee8-260ca411bfc5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Unset dirty status for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:37:58.719315 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bdc2fd0c-d6e7-485c-93cb-76580086b371 req-8eeb6d35-ed41-464f-aee8-260ca411bfc5 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.1896849
Jun 01 12:37:58.726183 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-20b3f33a-e49b-4c68-b1df-86ffa4492a26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:58.727774 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-20b3f33a-e49b-4c68-b1df-86ffa4492a26 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1053956
Jun 01 12:37:58.762168 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:58.764275 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.768388 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.771225 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b69dc0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'd2d1bbc3-bbff-4db5-abd1-679398f8f782', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.172', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '30a14b45-81e5-4718-a910-a6b768fc753f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:43:04:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:37:53Z', 'updated_at': '2021-06-01T12:37:53Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:37:58.776831 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15f57789-b58d-4d3a-b737-f4256339fa3b None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'd2d1bbc3-bbff-4db5-abd1-679398f8f782', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.172', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '30a14b45-81e5-4718-a910-a6b768fc753f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 499, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:43:04:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:37:53Z', 'updated_at': '2021-06-01T12:37:53Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:37:58.864182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.865919 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/618a82d3-59d4-4787-b8c4-7a2c63649640 HTTP/1.1" status: 204  len: 168 time: 0.7578645
Jun 01 12:37:58.875802 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bdc2fd0c-d6e7-485c-93cb-76580086b371 req-00a640a4-8dd8-4cdf-9bcd-99003f12a382 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1207631
Jun 01 12:37:58.906589 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.907157 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4cc34e86-2aec-44cb-a4d3-797d45bd3d9b {{(pid=91978) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:37:58.927270 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed33bd6b-2085-417e-8ebb-3b50323b6568 req-26d69df4-b5f3-4dfa-b90c-465552322e8c tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:37:58.929866 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ed33bd6b-2085-417e-8ebb-3b50323b6568 req-26d69df4-b5f3-4dfa-b90c-465552322e8c tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 950 time: 0.2199273
Jun 01 12:37:58.935101 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:58.937393 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] 10.222.0.81 "DELETE /v2.0/routers/4cc34e86-2aec-44cb-a4d3-797d45bd3d9b HTTP/1.1" status: 204  len: 168 time: 2.6980612
Jun 01 12:37:58.943957 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60826) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:58.985836 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device bcc33710-f3d9-4f03-8973-7059a54c1e11 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:37:58.991709 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-e6d8a73c-7a90-4470-9927-00bb3835df79 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2557001
Jun 01 12:37:59.005332 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ed33bd6b-2085-417e-8ebb-3b50323b6568 req-2e2ca967-70f5-48e9-86c6-e9b7603bb658 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0648253
Jun 01 12:37:59.057791 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_v2 [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Deleting subnet 6295b8a8-665d-493b-bc88-f7898265e5fa {{(pid=91979) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:37:59.069438 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: bcc33710-f3d9-4f03-8973-7059a54c1e11 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:37:59.069791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device bcc33710-f3d9-4f03-8973-7059a54c1e11 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:37:59.133165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.143122 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-763aceea-0eff-4d56-944d-c9a56459eaa5 None None] New status for floating IP d2d1bbc3-bbff-4db5-abd1-679398f8f782: ACTIVE {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:37:59.217542 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2204557'] for subnet, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.366856 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dbf137b-213d-4e86-bb72-c30a6313dfb4 req-84e49a7b-8ae4-4af1-b7d1-3427e734de8d service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3631923
Jun 01 12:37:59.382907 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.658703 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2610798', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2345669'] for subnet, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.663134 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-09006f58-d618-4f7d-947d-81d848e546b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:37:59.695817 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6295b8a8-665d-493b-bc88-f7898265e5fa,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:37:59.699673 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:37:59.702342 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.708378 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-8cb8d8ae-2677-4519-8057-c286d189a1c1 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/6295b8a8-665d-493b-bc88-f7898265e5fa HTTP/1.1" status: 204  len: 168 time: 0.7631521
Jun 01 12:37:59.710743 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60848) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:59.766549 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60854) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:37:59.820111 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.880563 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1765038833-network', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:37:59.885847 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:59.890324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Usage tracker for resource:network and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:59.893225 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:59.899253 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:59.912083 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Made reservation on behalf of c9f26a8407554421b6fc3162658b8a00 for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:37:59.915230 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.927838 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.943049 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:37:59.947118 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:37:59.950370 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:37:59.950520 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:37:59.956499 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:37:59.964940 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a25af1e50>,) {'filters': {'network_id': ['5cafd137-be6a-4c7c-b850-6777e5242610']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:00.013497 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25af1e50>, '1396a8b0-159e-40ec-9e21-d81bb2064dbc') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:00.013819 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a25af1e50>, '1396a8b0-159e-40ec-9e21-d81bb2064dbc') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:00.046933 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.051448 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.065698 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] vlan segment allocate from pool success with {'vlan_id': 758, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:38:00.074972 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.076271 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.076736 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Added segment c18cba8e-a441-49ac-8933-33a840319416 of type vlan for network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1
Jun 01 12:38:00.107118 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.115057 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.119608 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ddcfe9cd-428e-48d9-9713-76d1ad4f11a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:00.132973 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Releasing vlan 790 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:38:00.133470 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:38:00.147624 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:38:00.211535 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b4540638-fbb0-447a-9b8e-046c38d5174a,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:00.214799 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:00.218567 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.220977 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:00.221570 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.230154 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:00.236954 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-48aa24d4-4fa0-45d4-acad-34b19b3f06cf tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:00.238458 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-48aa24d4-4fa0-45d4-acad-34b19b3f06cf tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.95 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 950 time: 0.2635386
Jun 01 12:38:00.247308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccf2a46-3d3e-4eed-b8f5-eb74609641c0 req-7a35f19a-d3b9-4cab-a923-49346444a779 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:00.248742 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ccf2a46-3d3e-4eed-b8f5-eb74609641c0 req-7a35f19a-d3b9-4cab-a923-49346444a779 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.2423158
Jun 01 12:38:00.290329 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.325825 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:00.339098 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Pushing event updated for resources: {'Network': ['ID=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:00.341817 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:00.344490 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.351965 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:38:00.353293 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.5855827
Jun 01 12:38:00.356498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60864) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:00.366533 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eccbfce9-cbcc-4c8a-b1a3-100a32380970 req-4fb9fff6-1378-43e5-9861-847c49704b63 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:00.366780 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Pushing event deleted for resources: {'Network': ['ID=5cafd137-be6a-4c7c-b850-6777e5242610,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:00.368604 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-eccbfce9-cbcc-4c8a-b1a3-100a32380970 req-4fb9fff6-1378-43e5-9861-847c49704b63 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 950 time: 0.2416992
Jun 01 12:38:00.372088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Request body: {'subnet': {'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1765038833-subnet', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:00.377979 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:00.383324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Usage tracker for resource:subnet and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:00.398850 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:00.400251 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:00.410030 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:00.418782 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a72f5e6a-0f4d-4301-88a7-fd0cb443ea84 admin admin] 10.222.0.81 "DELETE /v2.0/networks/5cafd137-be6a-4c7c-b850-6777e5242610 HTTP/1.1" status: 204  len: 168 time: 0.7047067
Jun 01 12:38:00.426317 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2ccf2a46-3d3e-4eed-b8f5-eb74609641c0 req-081b6fe2-a2e4-4dc1-8099-b6b706cfa051 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1412122
Jun 01 12:38:00.435199 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Made reservation on behalf of c9f26a8407554421b6fc3162658b8a00 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:38:00.437646 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3089724'] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.458434 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Deleting port 088b6c92-39bc-4290-a691-b6c3320d5f73 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:38:00.458786 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.474566 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-eccbfce9-cbcc-4c8a-b1a3-100a32380970 req-f535d697-2ffd-4a5c-8d65-a9161b930792 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/security-groups?id=69c6073d-1679-46d2-8100-4d610a524427&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0939994
Jun 01 12:38:00.628488 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] For port 088b6c92-39bc-4290-a691-b6c3320d5f73, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=088b6c92-39bc-4290-a691-b6c3320d5f73,segment=NetworkSegment(09292cec-f1f4-42eb-9348-a59d2b14621d),segment_id=09292cec-f1f4-42eb-9348-a59d2b14621d)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:00.629832 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:00.642572 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60874) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:00.781660 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Calling delete_port for 088b6c92-39bc-4290-a691-b6c3320d5f73 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:38:00.831835 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-8a33b3fa-bf70-402f-ab57-a786ce86fb29 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5bf4a909afd242fab0afa824fd49eade&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1858897
Jun 01 12:38:00.832085 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60880) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:00.896266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device d6f1f113-e8d7-469b-a186-85c504c1ea64 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:38:00.947930 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: d6f1f113-e8d7-469b-a186-85c504c1ea64 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:38:00.948287 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device d6f1f113-e8d7-469b-a186-85c504c1ea64 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:38:00.992402 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.002454 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:01.004666 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['088b6c92-39bc-4290-a691-b6c3320d5f73'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:38:01.048626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2584281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3089706'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.054322 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:01.144690 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Pushing event updated for resources: {'Subnet': ['ID=6cb03821-94fa-4f9d-a846-04af6674699b,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:01.146953 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Checking segment: {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:01.147378 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Network hostable DHCP agents. Network: a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:38:01.150541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:01.160223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Pushing event deleted for resources: {'Port': ['ID=088b6c92-39bc-4290-a691-b6c3320d5f73,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:01.172442 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:38:01.181212 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:01.183436 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:01.193349 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c656194-b531-4b42-a40a-fd0504c84bc3 None None] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:38:01.198275 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:01.199106 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.224842 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.227250 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.8695254
Jun 01 12:38:01.228161 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 60886) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:01.234021 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:01.244825 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:01.249639 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Usage tracker for resource:router and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:01.252883 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:01.253210 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.262154 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:01.273936 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] No DVR routers for this DVR port 088b6c92-39bc-4290-a691-b6c3320d5f73 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:38:01.275179 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.276989 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.277604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.282111 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'name': 'network-vif-deleted', 'tag': '088b6c92-39bc-4290-a691-b6c3320d5f73'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:01.284385 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f399df49-037d-49b1-87d7-008b523597d2" -d '{"events": [{"server_uuid": "de63ad1a-a1c3-4748-8e71-b6021574aeb7", "name": "network-vif-deleted", "tag": "088b6c92-39bc-4290-a691-b6c3320d5f73"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:01.300786 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.314218 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3561f944-9c8e-4851-b59e-975cc4b686c8 req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.95 "DELETE /v2.0/ports/088b6c92-39bc-4290-a691-b6c3320d5f73 HTTP/1.1" status: 204  len: 173 time: 1.0615587
Jun 01 12:38:01.331998 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.336397 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7183a597-201c-4f67-8629-0b4f796481b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:01.366887 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cfdd0032-0469-43b7-885f-9499db64c6d7 x-openstack-request-id: req-cfdd0032-0469-43b7-885f-9499db64c6d7 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:01.367214 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de63ad1a-a1c3-4748-8e71-b6021574aeb7", "name": "network-vif-deleted", "tag": "088b6c92-39bc-4290-a691-b6c3320d5f73", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:01.367497 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-cfdd0032-0469-43b7-885f-9499db64c6d7 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:01.367912 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de63ad1a-a1c3-4748-8e71-b6021574aeb7', 'name': 'network-vif-deleted', 'tag': '088b6c92-39bc-4290-a691-b6c3320d5f73', 'status': 'completed', 'code': 200}
Jun 01 12:38:01.371674 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b2f9524-815b-4333-9acd-f83c8b50e6a5,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:01.375144 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:01.384965 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.389415 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/3b2f9524-815b-4333-9acd-f83c8b50e6a5 HTTP/1.1" status: 204  len: 168 time: 0.5562592
Jun 01 12:38:01.504115 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:38:01.504993 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.646710 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:01.704793 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5300e37-c5be-4ef0-ab50-edd5e976133d req-c6424b5a-1255-46f2-806a-61aaa7cb722e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:01.712676 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f5300e37-c5be-4ef0-ab50-edd5e976133d req-c6424b5a-1255-46f2-806a-61aaa7cb722e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.1064320
Jun 01 12:38:01.761547 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f5300e37-c5be-4ef0-ab50-edd5e976133d req-65f47116-5bbe-401a-bd38-2c77ee58d2aa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0479918
Jun 01 12:38:01.772143 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Allocated IP 172.20.0.2 (a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1/6cb03821-94fa-4f9d-a846-04af6674699b/2eeb3d6f-6070-419d-813c-808b79e5aab5) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:01.805178 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bd4d2b5a-809e-4931-98c1-67b5e99ac56c req-c884c3f0-167e-4b07-b533-07e13740efd9 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] 10.222.0.81 "GET /v2.0/ports?device_id=de63ad1a-a1c3-4748-8e71-b6021574aeb7 HTTP/1.1" status: 200  len: 210 time: 0.0538728
Jun 01 12:38:02.046219 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.064386 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Transition to ACTIVE for port object 2eeb3d6f-6070-419d-813c-808b79e5aab5 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:02.114826 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Transition to ACTIVE for port object 2eeb3d6f-6070-419d-813c-808b79e5aab5 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:02.117259 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.130704 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.136813 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:02.154571 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.222474 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:02.225977 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:02.231861 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:02.314380 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Pushing event updated for resources: {'Port': ['ID=2eeb3d6f-6070-419d-813c-808b79e5aab5,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:02.327791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:02.350683 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Attempting to bind port 2eeb3d6f-6070-419d-813c-808b79e5aab5 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:02.351036 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Allocated IP 172.27.3.158 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/5bf3a8a5-384d-48b6-8f8f-e7dae6300494) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:02.351491 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Attempting to bind port 2eeb3d6f-6070-419d-813c-808b79e5aab5 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:02.352072 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Attempting to bind port 2eeb3d6f-6070-419d-813c-808b79e5aab5 on network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:02.359251 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:02.359842 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Checking segment: {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:02.360347 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.360917 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Bound using segment: {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:02.361494 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Bound port: 2eeb3d6f-6070-419d-813c-808b79e5aab5, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:02.362012 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.487666 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] For port 2eeb3d6f-6070-419d-813c-808b79e5aab5, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:02.495160 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] For port 2eeb3d6f-6070-419d-813c-808b79e5aab5, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=2eeb3d6f-6070-419d-813c-808b79e5aab5,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:02.501338 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.508378 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:02.559672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60922) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:02.606142 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Pushing event updated for resources: {'Port': ['ID=2eeb3d6f-6070-419d-813c-808b79e5aab5,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:02.609920 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:02.704430 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-706859706-network', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:02.709983 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:02.714156 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Usage tracker for resource:network and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:02.717171 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:02.719864 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.725310 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:02.735914 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Made reservation on behalf of dc771aee219e4d5d914602852a126ac3 for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:38:02.739085 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.752267 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.767750 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:02.772132 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Usage tracker for resource:security_group_rule and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:02.776680 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:02.780592 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b043f0-55b1-4b8b-ad19-555d43851286 req-465ce32c-4185-42ec-9f1f-c95bf89a066c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:02.793269 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:02.793974 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a5b043f0-55b1-4b8b-ad19-555d43851286 req-465ce32c-4185-42ec-9f1f-c95bf89a066c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1504788
Jun 01 12:38:02.829056 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.837484 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:02.934415 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:02.941454 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.948152 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:02.948927 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:02.959076 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:02.960034 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-262bb7e2-025b-4356-86fc-c20d4ecc664e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:03.002340 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a5b043f0-55b1-4b8b-ad19-555d43851286 req-e6dc6223-0316-45c4-a409-5eb239d45308 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1935472
Jun 01 12:38:03.018737 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Pushing event updated for resources: {'Port': ['ID=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:03.021728 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:03.039904 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 2eeb3d6f-6070-419d-813c-808b79e5aab5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:03.050098 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] vlan segment allocate from pool success with {'vlan_id': 756, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:38:03.100077 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07eb3726-dcc5-496f-a9c4-76722dc43ebf,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:03.104747 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:03.128579 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.128927 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Added segment b8b27531-fca1-4879-a221-022c8b3c93f1 of type vlan for network a2f45554-20a3-4b02-a9ad-473554e8b2ed
Jun 01 12:38:03.156102 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 2eeb3d6f-6070-419d-813c-808b79e5aab5 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:03.173020 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.192507 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc6536b-7b2d-4130-bd05-cc0b6530d698 req-2f15d483-ed6d-46e2-a70f-6673f5f533e7 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:03.197078 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffc6536b-7b2d-4130-bd05-cc0b6530d698 req-2f15d483-ed6d-46e2-a70f-6673f5f533e7 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.2384684
Jun 01 12:38:03.250777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.255931 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:03.256650 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.264273 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:03.290193 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffc6536b-7b2d-4130-bd05-cc0b6530d698 req-023b7075-0d8b-435e-bdf1-18f831dc972a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0854652
Jun 01 12:38:03.378197 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Pushing event updated for resources: {'Network': ['ID=a2f45554-20a3-4b02-a9ad-473554e8b2ed,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:03.383141 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:03.390763 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:38:03.402403 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6453da5a-3760-4b7a-b6de-0f3636543133 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 0.8411708
Jun 01 12:38:03.403713 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60944) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:03.405814 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 088b6c92-39bc-4290-a691-b6c3320d5f73 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:38:03.410676 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Request body: {'subnet': {'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-subnet', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:03.416266 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:03.422478 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Usage tracker for resource:subnet and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:03.427218 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:03.437236 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:03.470300 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Made reservation on behalf of dc771aee219e4d5d914602852a126ac3 for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:38:03.475097 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2345690'] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.475330 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 088b6c92-39bc-4290-a691-b6c3320d5f73 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:38:03.475863 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 088b6c92-39bc-4290-a691-b6c3320d5f73 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:38:03.500665 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.859637 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f47b2d2d-2895-4f43-86b8-fa4cf621f90b None None] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:38:03.920110 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.943592 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Provisioning for port 2eeb3d6f-6070-419d-813c-808b79e5aab5 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:03.960919 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Provisioning complete for port 2eeb3d6f-6070-419d-813c-808b79e5aab5 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:03.961793 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.977922 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2610733', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2345676'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:03.985428 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:04.079584 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Pushing event updated for resources: {'Subnet': ['ID=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:04.080130 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Checking segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:04.080484 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Network hostable DHCP agents. Network: a2f45554-20a3-4b02-a9ad-473554e8b2ed, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:38:04.083500 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:04.106502 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:38:04.117702 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, a2f45554-20a3-4b02-a9ad-473554e8b2ed) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:04.133618 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:04.134345 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.160273 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-92d5b864-99ff-4910-b0ab-9cf178bc5c79 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 0.7550294
Jun 01 12:38:04.162798 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 60996) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:04.167294 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95c30722-e97f-4cc5-ad23-6687fd4b08a8 None None] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:38:04.171306 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:04.178696 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:04.184329 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Usage tracker for resource:router and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:04.189072 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:04.196332 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:04.210895 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.212238 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.218966 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Router 43f207c7-1198-400a-9361-6f9c7b4a3880 is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91978) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:38:04.248536 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.448942 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.570419 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] For port 2eeb3d6f-6070-419d-813c-808b79e5aab5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=2eeb3d6f-6070-419d-813c-808b79e5aab5,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:04.664051 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b13bb1-e5c2-4e8a-8907-2e8e9c24a465 req-521bab90-a14a-4852-9698-09de4b0d502b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:04.671886 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.672113 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d3b13bb1-e5c2-4e8a-8907-2e8e9c24a465 req-521bab90-a14a-4852-9698-09de4b0d502b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.3714821
Jun 01 12:38:04.679836 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:04.690709 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:04.729188 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.733026 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56201864-344a-4b14-9275-688bfb03827d None None] Sync routers for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:04.733222 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 3.5016143
Jun 01 12:38:04.739785 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 32800) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:04.749520 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d3b13bb1-e5c2-4e8a-8907-2e8e9c24a465 req-a52d07f0-48d7-4a23-a782-17c699052bc6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0759225
Jun 01 12:38:04.753827 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.769593 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:04.770224 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45070>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:04.819311 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:38:04.820140 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:04.917647 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9fa4d6-fee8-4565-ae5e-652184cd2a24 req-e0ba48c5-2153-46be-aff8-ca08ccedc0f4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:04.919258 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee9fa4d6-fee8-4565-ae5e-652184cd2a24 req-e0ba48c5-2153-46be-aff8-ca08ccedc0f4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.4902160
Jun 01 12:38:04.926755 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Pushing event updated for resources: {'Port': ['ID=2eeb3d6f-6070-419d-813c-808b79e5aab5,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:04.929949 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:05.104098 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:05.106805 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee9fa4d6-fee8-4565-ae5e-652184cd2a24 req-46f6ac0c-5280-40be-8bfb-2f557971f8db tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1369112
Jun 01 12:38:05.296480 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-2656ab74-8e2c-451c-bfff-7dcc007e03fa None None] Provisioning complete for port 2eeb3d6f-6070-419d-813c-808b79e5aab5 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:05.296748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2656ab74-8e2c-451c-bfff-7dcc007e03fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:05.361024 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Allocated IP 172.20.0.2 (a2f45554-20a3-4b02-a9ad-473554e8b2ed/37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5/10374f0b-4126-4956-a5ac-064402357230) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:05.426444 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device db567b77-bbc1-4e8f-95eb-46817c3ec9d6 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:38:05.671715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:05.707338 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:05.906581 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:05.930802 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:05.938271 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45070>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:03Z', 'revision_number': 3, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:05.940239 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'port_id': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'mac_address': 'fa:16:3e:1a:fe:d7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 792, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:38:05.949423 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56201864-344a-4b14-9275-688bfb03827d None None] Checking router: 43f207c7-1198-400a-9361-6f9c7b4a3880 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:05.949766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56201864-344a-4b14-9275-688bfb03827d None None] Updating router 43f207c7-1198-400a-9361-6f9c7b4a3880 port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:38:05.975780 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Transition to ACTIVE for port object 10374f0b-4126-4956-a5ac-064402357230 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:05.998370 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Allocated IP 172.27.3.87 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/9e1ab1d9-1e02-4ae5-97fa-020b06a3870e) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:06.014367 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.058156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc7d04cf-39ee-4042-b1d5-73f8781efa12 req-72227d15-f2ad-40d8-8e41-159a0df42adf tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:06.066678 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Transition to ACTIVE for port object 10374f0b-4126-4956-a5ac-064402357230 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:06.067642 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-fc7d04cf-39ee-4042-b1d5-73f8781efa12 req-72227d15-f2ad-40d8-8e41-159a0df42adf tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1338823
Jun 01 12:38:06.082791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.088857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f365f4a1-f065-476c-af89-a680af9314b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:06.120936 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-fc7d04cf-39ee-4042-b1d5-73f8781efa12 req-e5d9f546-036c-48e2-8a41-fcb9e9be3164 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0409935
Jun 01 12:38:06.122264 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.131449 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56201864-344a-4b14-9275-688bfb03827d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.208566 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id db567b77-bbc1-4e8f-95eb-46817c3ec9d6 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:38:06.222510 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:06.230793 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:06.245835 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:06.248057 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Pushing event updated for resources: {'Port': ['ID=10374f0b-4126-4956-a5ac-064402357230,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:06.251666 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:06.346604 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:06.387249 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.397060 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:06.475908 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Attempting to bind port 10374f0b-4126-4956-a5ac-064402357230 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:06.476456 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Attempting to bind port 10374f0b-4126-4956-a5ac-064402357230 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:06.476714 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Attempting to bind port 10374f0b-4126-4956-a5ac-064402357230 on network a2f45554-20a3-4b02-a9ad-473554e8b2ed {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:06.487613 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:06.488041 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Checking segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:06.488444 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.488901 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Bound using segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:06.489378 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Bound port: 10374f0b-4126-4956-a5ac-064402357230, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:06.489755 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.505514 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:06.508646 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:06.596368 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] For port 10374f0b-4126-4956-a5ac-064402357230, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:06.601765 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] For port 10374f0b-4126-4956-a5ac-064402357230, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=10374f0b-4126-4956-a5ac-064402357230,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:06.606748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.611767 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:06.619749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.649391 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['db567b77-bbc1-4e8f-95eb-46817c3ec9d6'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:38:06.669194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:06.673655 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Allocated IP 172.20.0.1 (a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1/6cb03821-94fa-4f9d-a846-04af6674699b/1fb85678-c033-49a9-9d95-b4981b00a7a1) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:06.676004 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d47c3897-54c1-4b87-a4ef-85c747ce3972 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:06.712469 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37983d38-98b1-4b49-8122-7bb434901ffe req-5ae90dc8-f8d4-44e3-83f4-4c07c4273d35 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:06.713953 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37983d38-98b1-4b49-8122-7bb434901ffe req-5ae90dc8-f8d4-44e3-83f4-4c07c4273d35 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 944 time: 0.2973301
Jun 01 12:38:06.780409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:06.806531 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:06.817894 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:06.863976 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Pushing event updated for resources: {'Port': ['ID=10374f0b-4126-4956-a5ac-064402357230,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:06.880014 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.266s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:06.895140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Pushing event updated for resources: {'Port': ['ID=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:06.907110 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:06.938261 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37983d38-98b1-4b49-8122-7bb434901ffe req-f57d571d-48a6-499b-816c-465c71f650e8 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2072773
Jun 01 12:38:06.979960 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 2eeb3d6f-6070-419d-813c-808b79e5aab5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:07.152844 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56201864-344a-4b14-9275-688bfb03827d None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.195014 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-56201864-344a-4b14-9275-688bfb03827d None None] Transition to ACTIVE for port object 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:07.219096 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56201864-344a-4b14-9275-688bfb03827d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.230215 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:07.279589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.285747 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 2eeb3d6f-6070-419d-813c-808b79e5aab5 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:07.286136 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.298590 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Transition to ACTIVE for port object 1fb85678-c033-49a9-9d95-b4981b00a7a1 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:07.328283 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.339708 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:07.412463 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb11d4b-d7b4-4702-8f62-1cefa8b54eb9 req-ccd52377-d21a-4b6f-b087-8c3977b2102f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:07.415057 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6eb11d4b-d7b4-4702-8f62-1cefa8b54eb9 req-ccd52377-d21a-4b6f-b087-8c3977b2102f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1419084
Jun 01 12:38:07.436873 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29aafb66-e32b-46d2-bf21-070a445474ea None None] Pushing event updated for resources: {'Port': ['ID=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:07.441099 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:07.446620 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-29aafb66-e32b-46d2-bf21-070a445474ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:07.447051 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:07.447600 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-56201864-344a-4b14-9275-688bfb03827d None None] Attempting to bind port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:07.448105 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-56201864-344a-4b14-9275-688bfb03827d None None] Attempting to bind port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:07.448420 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56201864-344a-4b14-9275-688bfb03827d None None] Attempting to bind port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:07.453997 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:07.473474 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6eb11d4b-d7b4-4702-8f62-1cefa8b54eb9 req-bc54a9f3-acba-4604-a576-739495fd0141 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0529490
Jun 01 12:38:07.477549 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56201864-344a-4b14-9275-688bfb03827d None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:07.477932 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56201864-344a-4b14-9275-688bfb03827d None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:07.478338 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56201864-344a-4b14-9275-688bfb03827d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.478738 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56201864-344a-4b14-9275-688bfb03827d None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:07.479220 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-56201864-344a-4b14-9275-688bfb03827d None None] Bound port: 5bf3a8a5-384d-48b6-8f8f-e7dae6300494, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:07.479599 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56201864-344a-4b14-9275-688bfb03827d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.555263 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Pushing event updated for resources: {'Port': ['ID=1fb85678-c033-49a9-9d95-b4981b00a7a1,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:07.558167 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:07.608465 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.669463 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-56201864-344a-4b14-9275-688bfb03827d None None] For port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:07.687847 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-56201864-344a-4b14-9275-688bfb03827d None None] For port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:07.695870 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-56201864-344a-4b14-9275-688bfb03827d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.708755 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f15add1d-d10b-4e07-ab43-1e49ff4b75dc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:07.724933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:07.835982 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:07.836882 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45070>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:07.895109 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5c52512d-85b9-4d18-b465-f1e8a84be90a None None] Provisioning for port 1fb85678-c033-49a9-9d95-b4981b00a7a1 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:07.912550 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29aafb66-e32b-46d2-bf21-070a445474ea None None] Pushing event updated for resources: {'Port': ['ID=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:07.930549 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-29aafb66-e32b-46d2-bf21-070a445474ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:07.933897 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5c52512d-85b9-4d18-b465-f1e8a84be90a None None] Provisioning complete for port 1fb85678-c033-49a9-9d95-b4981b00a7a1 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:07.934283 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5c52512d-85b9-4d18-b465-f1e8a84be90a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:08.093177 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fef49af8-6cfd-48ce-b98f-6b7bb9e24764 None None] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:38:08.136680 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-5c52512d-85b9-4d18-b465-f1e8a84be90a None None] Port 1fb85678-c033-49a9-9d95-b4981b00a7a1 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:08.219287 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:08.222925 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:08.386572 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:08.463246 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-b2978100-c51a-46c7-9656-138c5a6aa622 None None] Provisioning for port 10374f0b-4126-4956-a5ac-064402357230 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:08.480808 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81bebaf-9acd-48a0-af43-bfeb0560d5ee req-bc54389d-fb3e-490e-8a36-26b50bfffe91 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:08.482252 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c81bebaf-9acd-48a0-af43-bfeb0560d5ee req-bc54389d-fb3e-490e-8a36-26b50bfffe91 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 944 time: 0.3599329
Jun 01 12:38:08.674437 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-56201864-344a-4b14-9275-688bfb03827d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45070>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:03Z', 'revision_number': 3, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:08.679781 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56201864-344a-4b14-9275-688bfb03827d None None] The sync data for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi is: [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:03Z', 'revision_number': 3, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:08.689896 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c81bebaf-9acd-48a0-af43-bfeb0560d5ee req-44a0e441-db35-45d5-a8cc-e809965bc5d7 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1605828
Jun 01 12:38:08.779854 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b66474-e750-4d43-b10f-3406aa96bab9 req-87820229-328a-4f46-9404-45ecf5882323 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:08.791162 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e2b66474-e750-4d43-b10f-3406aa96bab9 req-87820229-328a-4f46-9404-45ecf5882323 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1736808
Jun 01 12:38:08.793799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:08.809993 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:08.832047 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 32952) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:08.844129 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-90c55a15-4eec-4842-9600-3390e51d6c70 tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:08.896497 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e2b66474-e750-4d43-b10f-3406aa96bab9 req-531da0bd-89a4-4083-b621-7ab5eb6d4ef5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1042926
Jun 01 12:38:08.901351 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Router 7e176463-91d5-4735-ab79-0ea7c34c6767 is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91979) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:38:08.960750 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.034431 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 10374f0b-4126-4956-a5ac-064402357230 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:09.064648 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Pushing event updated for resources: {'Port': ['ID=1fb85678-c033-49a9-9d95-b4981b00a7a1,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:09.081200 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:09.114144 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ecb58717-6f11-4c4f-bd3c-ddac6581e00d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=9dd6c4da99af404092bfb121ac1369ae&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2807093
Jun 01 12:38:09.114758 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 32958) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:09.131735 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 10374f0b-4126-4956-a5ac-064402357230 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:09.142875 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 10374f0b-4126-4956-a5ac-064402357230 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:09.143284 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.191257 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.221011 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.280084 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.282264 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.289669 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2a58f696-1a24-4fd2-8a37-475469b620c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:09.310187 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69c6073d-1679-46d2-8100-4d610a524427,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:09.320744 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:09.327533 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.337343 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 10374f0b-4126-4956-a5ac-064402357230, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=10374f0b-4126-4956-a5ac-064402357230,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:09.343289 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.345857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6bf6d2e6-9d39-48c9-811f-687807979dd8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:09.349162 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:09.360641 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Sync routers for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:09.364706 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/69c6073d-1679-46d2-8100-4d610a524427 HTTP/1.1" status: 204  len: 168 time: 0.2149022
Jun 01 12:38:09.374410 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:09.374973 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fb6f40>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:09.381756 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:09.384173 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:09.430265 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=10374f0b-4126-4956-a5ac-064402357230,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:09.435482 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:09.469110 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device db567b77-bbc1-4e8f-95eb-46817c3ec9d6 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:09.511250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Notify callbacks [] for router, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.528813 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 5.3517582
Jun 01 12:38:09.529688 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 32964) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:09.688039 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:09.706362 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:09.706800 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.799939 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Router 43f207c7-1198-400a-9361-6f9c7b4a3880 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:38:09.937908 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-8aa81a65-855f-4c30-9d78-b3bdb323ed87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.941031 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:09.958618 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:09.969260 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-b994fd32-cd5d-4730-9327-23d3dfce7fd3 None None] Provisioning complete for port 1fb85678-c033-49a9-9d95-b4981b00a7a1 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:09.969794 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b994fd32-cd5d-4730-9327-23d3dfce7fd3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:10.061626 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:10.063462 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:10.067184 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-611da43b-5f13-4799-bf78-7b80b09ba864" -d '{"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-plugged", "status": "completed", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:10.074492 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:10.080639 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-cd3e7cfe-f6fd-495f-a0d6-ac11985f9966 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:10.147122 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-b994fd32-cd5d-4730-9327-23d3dfce7fd3 None None] Port 1fb85678-c033-49a9-9d95-b4981b00a7a1 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:10.171476 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:10.184028 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:10.210831 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:10.225657 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] 10.222.0.81 "PUT /v2.0/routers/43f207c7-1198-400a-9361-6f9c7b4a3880/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.4784164
Jun 01 12:38:10.292538 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca46aca2-9c17-4496-9957-a2319ed2c08f req-2128df10-e073-42c4-a7d4-569a69385a8c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:10.294389 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca46aca2-9c17-4496-9957-a2319ed2c08f req-2128df10-e073-42c4-a7d4-569a69385a8c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.3823297
Jun 01 12:38:10.312095 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979ed13b-be90-46d0-b7cf-3faa8734cc79 req-57ff3273-c20d-4119-a570-6850aae96581 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:10.315762 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-979ed13b-be90-46d0-b7cf-3faa8734cc79 req-57ff3273-c20d-4119-a570-6850aae96581 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.2058911
Jun 01 12:38:10.352050 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca46aca2-9c17-4496-9957-a2319ed2c08f req-46e37876-ed6b-4b7e-97c5-5fd1debaf63f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0518503
Jun 01 12:38:10.379227 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fb6f40>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 3, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:10.385113 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Checking router: 7e176463-91d5-4735-ab79-0ea7c34c6767 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:10.385644 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Updating router 7e176463-91d5-4735-ab79-0ea7c34c6767 port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:38:10.415965 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c06e758-697c-4787-b617-53a5360dc8a0 x-openstack-request-id: req-4c06e758-697c-4787-b617-53a5360dc8a0 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:10.416341 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-plugged", "status": "completed", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:10.416692 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-4c06e758-697c-4787-b617-53a5360dc8a0 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:10.417147 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'code': 200}
Jun 01 12:38:10.440916 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-979ed13b-be90-46d0-b7cf-3faa8734cc79 req-43fdc1e6-ca46-4591-a764-3b5c1b3ac09e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1156180
Jun 01 12:38:10.456769 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:10.681708 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:10.891555 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:38:10.937095 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dfea5fa-1ebc-4b26-92fc-7304b366f8fa req-8cb6a6e6-758e-47ed-8501-9ff13d2ac62c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:10.940810 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1dfea5fa-1ebc-4b26-92fc-7304b366f8fa req-8cb6a6e6-758e-47ed-8501-9ff13d2ac62c service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1098 time: 0.1805973
Jun 01 12:38:11.009777 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1dfea5fa-1ebc-4b26-92fc-7304b366f8fa req-b823f213-9746-44a9-a65d-fb699bd83311 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0614581
Jun 01 12:38:11.024610 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.052181 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Transition to ACTIVE for port object 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:11.060045 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.078372 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-1298bb8b-9a89-4527-8001-b29ec605b77c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:11.097341 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Sync routers for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:11.115566 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:11.155642 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:11.156413 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45d00>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:11.165365 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Allocated IP 172.20.0.1 (a2f45554-20a3-4b02-a9ad-473554e8b2ed/37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5/abab8eea-b119-4add-835f-fd819aeea2ce) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:11.190664 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 32988) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:11.197360 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2044626514-network', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:11.198668 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Pushing event updated for resources: {'Port': ['ID=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,revision_number=2']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:11.203788 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:11.205212 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Attempting to bind port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:11.205798 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Attempting to bind port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:11.206443 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Attempting to bind port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:11.208529 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Usage tracker for resource:network and tenant:d5d4ae84f265473eb98954af0f01a963 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:11.211853 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:11.218142 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.218770 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.219338 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.219895 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.220161 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:11.220741 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.221611 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.222163 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.222954 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.223508 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.224037 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.224720 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.225283 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:11.233036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Made reservation on behalf of d5d4ae84f265473eb98954af0f01a963 for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:38:11.236025 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.238699 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 37, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:11.239387 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:11.240025 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.240737 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:11.241467 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Bound port: 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:11.242201 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.251005 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.270849 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:11.271748 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:11.277223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Usage tracker for resource:security_group_rule and tenant:d5d4ae84f265473eb98954af0f01a963 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:11.280704 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:11.286822 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:11.343801 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.348036 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] For port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:11.351865 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:11.355028 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] For port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:11.361439 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:11.361845 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.362001 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.provisioning_blocks [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Transition to ACTIVE for port object abab8eea-b119-4add-835f-fd819aeea2ce will not be triggered until provisioned by entity DHCP. {{(pid=91978) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:11.363451 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.370344 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:11.405549 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:11.416056 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.422084 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.423222 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.425545 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-033e7f85-2420-49e7-8148-869d9099ab7b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:11.439257 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:11.473186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] vlan segment allocate from pool success with {'vlan_id': 750, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:38:11.480246 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=217cba42-772c-4701-889f-404e8b8ad8f1,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:11.485081 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:11.490001 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.490568 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Added segment d157676f-795c-471e-8e61-958dc1e2cb97 of type vlan for network 0c0b6436-f8c8-4324-8b99-db3df38ef70c
Jun 01 12:38:11.524365 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Pushing event updated for resources: {'Port': ['ID=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:11.530837 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:11.532059 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:11.532926 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fb6f40>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:37:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:11.537397 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.574651 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.577270 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:11.577932 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.585242 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:11.666528 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:11.667515 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Pushing event updated for resources: {'Port': ['ID=abab8eea-b119-4add-835f-fd819aeea2ce,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:11.680491 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:11.682401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:11.683081 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:11.758171 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:11.796082 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.839023 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 0.6469972
Jun 01 12:38:11.855640 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 32998) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:11.863268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Pushing event updated for resources: {'Network': ['ID=0c0b6436-f8c8-4324-8b99-db3df38ef70c,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:11.876792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:11.880216 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:11.911970 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:38:11.944399 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:11.959832 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa968359-0829-4479-966b-5597c15eb6a4 req-cbacfbf2-c4e3-44c6-a644-3dd0d760aa79 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:11.966613 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa968359-0829-4479-966b-5597c15eb6a4 req-cbacfbf2-c4e3-44c6-a644-3dd0d760aa79 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.2863677
Jun 01 12:38:12.013363 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.014802 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 10374f0b-4126-4956-a5ac-064402357230 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:12.031121 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa968359-0829-4479-966b-5597c15eb6a4 req-ced0eefd-6674-4536-99ef-c60245734622 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0573149
Jun 01 12:38:12.049959 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-29aafb66-e32b-46d2-bf21-070a445474ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:12.089616 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Request body: {'subnet': {'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2044626514-subnet', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'ip_version': 4}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:12.110160 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:12.120606 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Usage tracker for resource:subnet and tenant:d5d4ae84f265473eb98954af0f01a963 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:12.123499 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:12.139269 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:12.179481 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Made reservation on behalf of d5d4ae84f265473eb98954af0f01a963 for: {'subnet': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:38:12.179708 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.181545 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-3089724'] for subnet, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.204234 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fb6f40>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 3, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:12.208248 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:12.209479 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0dfa0e-aa8f-45d2-b919-36517f5ea933 None None] The sync data for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi is: [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 3, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:12.209738 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6136c9-a00e-4e90-a460-069bc256655a req-bb24aa16-f69b-4ccb-8236-b64df0f233d1 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:12.211395 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7f6136c9-a00e-4e90-a460-069bc256655a req-bb24aa16-f69b-4ccb-8236-b64df0f233d1 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.4875023
Jun 01 12:38:12.213879 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:12.216057 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-154ab8d7-55eb-4f5a-9058-cccdb0b2bdae None None] Provisioning for port abab8eea-b119-4add-835f-fd819aeea2ce completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:12.226219 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-154ab8d7-55eb-4f5a-9058-cccdb0b2bdae None None] Provisioning complete for port abab8eea-b119-4add-835f-fd819aeea2ce triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:12.226604 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-154ab8d7-55eb-4f5a-9058-cccdb0b2bdae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.279135 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45d00>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:08Z', 'revision_number': 2, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:12.285299 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 10374f0b-4126-4956-a5ac-064402357230 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:12.285656 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.329899 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Checking router: 43f207c7-1198-400a-9361-6f9c7b4a3880 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:12.330262 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Updating router 43f207c7-1198-400a-9361-6f9c7b4a3880 port 1fb85678-c033-49a9-9d95-b4981b00a7a1 binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:38:12.364522 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7f6136c9-a00e-4e90-a460-069bc256655a req-ea38ba60-d56f-4bf3-8eb9-5510c6f5dca5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0962150
Jun 01 12:38:12.396584 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-154ab8d7-55eb-4f5a-9058-cccdb0b2bdae None None] Port abab8eea-b119-4add-835f-fd819aeea2ce cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:12.407871 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.414367 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.462819 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.728206 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7906aeb7-34b4-4328-9b54-f69dceccfc99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.857513 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.867575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.903501 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:12.940332 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.955971 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Transition to ACTIVE for port object 1fb85678-c033-49a9-9d95-b4981b00a7a1 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:12.963925 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:12.974872 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-4c5bc204-11c6-4252-8b9f-d4d45f3368eb None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:13.038034 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:13.111475 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:13.127845 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Pushing event updated for resources: {'Port': ['ID=abab8eea-b119-4add-835f-fd819aeea2ce,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:13.139486 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea2ccba-e14d-42ef-8cbf-1a3247aba0d8 None None] Pushing event updated for resources: {'Port': ['ID=1fb85678-c033-49a9-9d95-b4981b00a7a1,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:13.144721 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:13.167641 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-0ea2ccba-e14d-42ef-8cbf-1a3247aba0d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:13.289387 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Attempting to bind port 1fb85678-c033-49a9-9d95-b4981b00a7a1 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:13.290674 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Attempting to bind port 1fb85678-c033-49a9-9d95-b4981b00a7a1 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:13.291043 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Attempting to bind port 1fb85678-c033-49a9-9d95-b4981b00a7a1 on network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:13.305373 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 38, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:13.305660 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Checking segment: {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:13.306156 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:13.306458 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Bound using segment: {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:13.306936 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Bound port: 1fb85678-c033-49a9-9d95-b4981b00a7a1, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:13.307311 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:13.332009 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17b38581-7ce8-4c4f-bed7-2bb94e6a1531 req-f08a4d3b-097e-4e15-b0c5-31e1c1dd135e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:13.339922 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-17b38581-7ce8-4c4f-bed7-2bb94e6a1531 req-f08a4d3b-097e-4e15-b0c5-31e1c1dd135e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.1364639
Jun 01 12:38:13.375911 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:13.376286 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:13.402809 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-17b38581-7ce8-4c4f-bed7-2bb94e6a1531 req-7d7b3c40-59dd-49b4-a533-f98e87846874 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0617855
Jun 01 12:38:13.407012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2584281', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-3089706'] for subnet, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:13.416883 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:13.527603 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=af328333-62ea-4d73-aa26-e559eeb285f9,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:13.541573 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] For port 1fb85678-c033-49a9-9d95-b4981b00a7a1, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:13.556215 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] For port 1fb85678-c033-49a9-9d95-b4981b00a7a1, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=1fb85678-c033-49a9-9d95-b4981b00a7a1,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:13.562764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:13.563300 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:13.563979 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:13.570042 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:13.571526 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Checking segment: {'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:13.571889 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Network hostable DHCP agents. Network: 0c0b6436-f8c8-4324-8b99-db3df38ef70c, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91978) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:38:13.617995 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:13.624242 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:13.638624 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d78f1f76-57ca-480a-9092-e5b14ea4123f req-43ca0107-1ffa-4b73-9994-64672383712f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:13.646904 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d78f1f76-57ca-480a-9092-e5b14ea4123f req-43ca0107-1ffa-4b73-9994-64672383712f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.1218522
Jun 01 12:38:13.700066 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91978) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:38:13.722884 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:13.723610 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45d00>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:13.731501 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d78f1f76-57ca-480a-9092-e5b14ea4123f req-264eea95-8886-47d4-bd73-0f2b2efb32bf tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0830073
Jun 01 12:38:13.747437 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33010) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:13.803123 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 0c0b6436-f8c8-4324-8b99-db3df38ef70c) {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:13.836556 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:13.837139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:13.868099 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaab3168-2b95-4089-a94d-c292c34f6032 req-6b9c5a16-7095-4c1d-8edd-d2ea1148b1a5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:13.869768 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-eaab3168-2b95-4089-a94d-c292c34f6032 req-6b9c5a16-7095-4c1d-8edd-d2ea1148b1a5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.3499882
Jun 01 12:38:13.936830 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Router 7e176463-91d5-4735-ab79-0ea7c34c6767 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:38:13.944335 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5acf4da3-3618-4527-9a98-fe1084d1a4be None None] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:38:13.953768 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-c2178cb5-0d29-4894-b4ab-fb1702459bd0 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 2.0934565
Jun 01 12:38:13.954253 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33016) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:13.970015 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:13.973860 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-eaab3168-2b95-4089-a94d-c292c34f6032 req-4b32ca01-6b71-42ec-af13-922c6657bbd0 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0871694
Jun 01 12:38:13.979062 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:13.991449 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Usage tracker for resource:router and tenant:d5d4ae84f265473eb98954af0f01a963 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:13.996721 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:14.006132 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:14.008666 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea2ccba-e14d-42ef-8cbf-1a3247aba0d8 None None] Pushing event updated for resources: {'Port': ['ID=1fb85678-c033-49a9-9d95-b4981b00a7a1,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:14.031945 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:14.038267 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-1978742', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2871'] for router, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.039462 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1979510', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1981353', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-2042436', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2862'] for router, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.044251 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-0ea2ccba-e14d-42ef-8cbf-1a3247aba0d8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.420s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:14.061633 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.104224 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.127628 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:14.128008 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.203638 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-e84955d8-5aa2-42c1-848b-8c9ed8447ada None None] Provisioning complete for port abab8eea-b119-4add-835f-fd819aeea2ce triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:14.205048 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e84955d8-5aa2-42c1-848b-8c9ed8447ada None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.247973 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:14.254964 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] 10.222.0.81 "PUT /v2.0/routers/7e176463-91d5-4735-ab79-0ea7c34c6767/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.7229972
Jun 01 12:38:14.265699 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:14.449546 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Sync routers for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:14.478401 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:14.481073 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25ce0190>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:14.490376 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-e84955d8-5aa2-42c1-848b-8c9ed8447ada None None] Port abab8eea-b119-4add-835f-fd819aeea2ce cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:14.557308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1981324', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1978692', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2908'] for router, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.624088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069c8bfa-0c70-4548-98df-e9aafee36d5b req-1087e9fd-df0a-4f91-b3aa-b496eedb12d2 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:14.632367 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-069c8bfa-0c70-4548-98df-e9aafee36d5b req-1087e9fd-df0a-4f91-b3aa-b496eedb12d2 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.1562264
Jun 01 12:38:14.694090 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-069c8bfa-0c70-4548-98df-e9aafee36d5b req-c4f04cf9-f653-4d2b-9d9e-7ccf8d7b2de9 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0606487
Jun 01 12:38:14.755939 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:14.774737 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61b2f7a5-515c-4d6f-adc2-1943446d8440 tempest-TestShelveInstance-1599994117 tempest-TestShelveInstance-1599994117-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:14.775478 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-61b2f7a5-515c-4d6f-adc2-1943446d8440 tempest-TestShelveInstance-1599994117 tempest-TestShelveInstance-1599994117-project-admin] Synchronizing usage tracker for tenant:96abebccc0734fe388fae3749429552c on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:14.803836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-d4ae2745-e661-439c-83a5-e645e6bf7dd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:14.805424 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-d4ae2745-e661-439c-83a5-e645e6bf7dd8 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1098 time: 0.2289789
Jun 01 12:38:14.818641 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.839330 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-61b2f7a5-515c-4d6f-adc2-1943446d8440 tempest-TestShelveInstance-1599994117 tempest-TestShelveInstance-1599994117-project-admin] Unset dirty status for tenant:96abebccc0734fe388fae3749429552c on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:14.840840 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-61b2f7a5-515c-4d6f-adc2-1943446d8440 tempest-TestShelveInstance-1599994117 tempest-TestShelveInstance-1599994117-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1093 time: 1.0893803
Jun 01 12:38:14.845771 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33030) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:14.852836 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'port_id': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'fixed_ip_address': '172.20.0.4'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:14.853562 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpaedda9a1-faff-5428-8149-097e0964f008-0c0b6436-f8c8-4324-8b99-db3df38ef70c', 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'fixed_ips': [{'subnet_id': 'af328333-62ea-4d73-aa26-e559eeb285f9'}]}} from dv-cinder-793515-2-iscsi. {{(pid=91980) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
Jun 01 12:38:14.854499 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.866053 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:14.873212 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Usage tracker for resource:floatingip and tenant:a4d9bab00fe345e0b899bc42ea4416e0 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:14.881380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:14.882327 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:14.898430 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.901850 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:14.929775 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for floatingip, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:14.939666 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-d466a193-e3a8-4dc0-8766-749c696ac58f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:15.111054 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:15.116737 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:15.132962 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.146105 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-2db48503-acf7-495c-9d1d-932b2620a967 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:15.149485 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-2db48503-acf7-495c-9d1d-932b2620a967 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.3357961
Jun 01 12:38:15.217784 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33034) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:15.223934 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'security_group': {'name': 'tempest-securitygroup--721976937', 'description': 'tempest-description--1898115190'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:15.227168 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.db_base_plugin_common [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Allocated IP 172.20.0.2 (0c0b6436-f8c8-4324-8b99-db3df38ef70c/af328333-62ea-4d73-aa26-e559eeb285f9/5b0a906d-d514-4e3a-8cab-b34537beb9a5) {{(pid=91980) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:15.237702 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e45d00>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:13Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:15.239109 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:15.246612 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a7221ba-d67f-4ce1-9304-ff26387a44d6 None None] The sync data for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi is: [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:13Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:15.247726 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:15.251383 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:15.262088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:15.305521 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25ce0190>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 2, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:15.338679 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Checking router: 7e176463-91d5-4735-ab79-0ea7c34c6767 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:15.339141 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Updating router 7e176463-91d5-4735-ab79-0ea7c34c6767 port abab8eea-b119-4add-835f-fd819aeea2ce binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:38:15.340353 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.368156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:15.387410 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group_rule and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:15.395426 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:15.407772 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:15.417437 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Allocated IP 172.27.3.155 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/cabbdb3b-99a1-4827-8288-2d2bc4e300a8) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:15.455264 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.550292 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-2722360b-049f-4a51-989a-0c73794eb43c service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 1001 time: 0.3935318
Jun 01 12:38:15.606611 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Notify callbacks [] for port, precommit_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.621153 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Transition to ACTIVE for port object 5b0a906d-d514-4e3a-8cab-b34537beb9a5 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:15.643536 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.644097 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Transition to ACTIVE for port object 5b0a906d-d514-4e3a-8cab-b34537beb9a5 will not be triggered until provisioned by entity DHCP. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:15.658843 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314'] for port, after_create {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.662319 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.666926 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:15.695068 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-c10e7d5b-f553-4308-8957-a3f766450be1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:15.708816 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.711302 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.715048 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.716571 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 0.4976156
Jun 01 12:38:15.722505 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33040) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:15.743935 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'security_group_rule': {'security_group_id': '3bc3847f-727c-4094-9173-73ca49a9dc5e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:15.752392 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.755664 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:15.756727 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-80a22434-272e-4485-aa55-66c697913202 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:15.756854 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Pushing event updated for resources: {'Port': ['ID=5b0a906d-d514-4e3a-8cab-b34537beb9a5,revision_number=1']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:15.758178 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-80a22434-272e-4485-aa55-66c697913202 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.1979265
Jun 01 12:38:15.760103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:15.767145 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3bc3847f-727c-4094-9173-73ca49a9dc5e,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:15.774545 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.777287 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c is already hosted by enough agents. {{(pid=91980) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:15.778533 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.scheduler.base_scheduler [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Resources bound (agent type, host, resource id):  {{(pid=91980) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:15.779000 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group_rule and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:15.781952 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Received port after_create {{(pid=91980) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:15.787945 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:15.806190 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.806566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.806937 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.807300 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.807661 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.808016 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.808373 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.808753 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.809100 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.809453 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.809805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.810185 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:15.829628 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:15.838316 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9fa38843-e36d-4b42-ac30-6697943bf3b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:15.864799 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.894094 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Attempting to bind port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:15.894527 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Attempting to bind port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:15.898557 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Attempting to bind port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 on network 0c0b6436-f8c8-4324-8b99-db3df38ef70c {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:15.906173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 38, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:15.906554 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Checking segment: {'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:15.907024 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:15.907426 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Bound using segment: {'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:15.908262 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Bound port: 5b0a906d-d514-4e3a-8cab-b34537beb9a5, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:15.908686 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.012548 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.029348 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:16.034473 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] For port 5b0a906d-d514-4e3a-8cab-b34537beb9a5, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:16.038424 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] For port 5b0a906d-d514-4e3a-8cab-b34537beb9a5, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=5b0a906d-d514-4e3a-8cab-b34537beb9a5,segment=NetworkSegment(d157676f-795c-471e-8e61-958dc1e2cb97),segment_id=d157676f-795c-471e-8e61-958dc1e2cb97)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:16.043731 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.057226 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:16.070200 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.083727 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Transition to ACTIVE for port object abab8eea-b119-4add-835f-fd819aeea2ce will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:16.094893 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.099346 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-6345e612-1249-4069-9c76-0370b902d7ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:16.101191 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-6345e612-1249-4069-9c76-0370b902d7ab service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2836485
Jun 01 12:38:16.113522 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:16.132667 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Allocated IP 172.27.3.131 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/7b67088d-5113-4748-859f-22ad3e8702e9) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:16.166380 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Pushing event updated for resources: {'Port': ['ID=5b0a906d-d514-4e3a-8cab-b34537beb9a5,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:16.170363 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:16.170767 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:16.187414 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:16.199461 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:16.283317 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'Port': ['ID=cabbdb3b-99a1-4827-8288-2d2bc4e300a8,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:16.297885 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.268s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:16.315149 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a05603f3-cbd7-4e24-a74e-e69f750b686f None None] Pushing event updated for resources: {'Port': ['ID=abab8eea-b119-4add-835f-fd819aeea2ce,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:16.320386 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-a05603f3-cbd7-4e24-a74e-e69f750b686f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:16.326434 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.344009 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.416451 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:16.462480 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17581c6f-afa1-4d4a-9170-c4314b81a702 req-631208e4-12ca-4fa7-8882-0bdc72142d9e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:16.464043 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-17581c6f-afa1-4d4a-9170-c4314b81a702 req-631208e4-12ca-4fa7-8882-0bdc72142d9e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.5419648
Jun 01 12:38:16.467811 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Attempting to bind port abab8eea-b119-4add-835f-fd819aeea2ce on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:16.468280 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Attempting to bind port abab8eea-b119-4add-835f-fd819aeea2ce by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:16.468705 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Attempting to bind port abab8eea-b119-4add-835f-fd819aeea2ce on network a2f45554-20a3-4b02-a9ad-473554e8b2ed {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:16.476777 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 38, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:16.477253 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Checking segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:16.480367 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.480910 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Bound using segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:16.482256 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Bound port: abab8eea-b119-4add-835f-fd819aeea2ce, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:16.483335 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.496281 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bf284517-489b-4291-bd26-877d96627393,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:16.522548 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-90fc8c80-b891-40c6-b4eb-c07f5c1b2305 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4094238
Jun 01 12:38:16.573244 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:16.581489 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.583372 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-8885c80c-d4ab-410c-991b-bf3453b14012 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.8568904
Jun 01 12:38:16.591647 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33044) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:16.623571 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'security_group_rule': {'security_group_id': '3bc3847f-727c-4094-9173-73ca49a9dc5e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:16.666640 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.707895 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] For port abab8eea-b119-4add-835f-fd819aeea2ce, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:16.717043 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] For port abab8eea-b119-4add-835f-fd819aeea2ce, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=abab8eea-b119-4add-835f-fd819aeea2ce,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:16.726127 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.740460 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-74092b70-f97f-4e2e-a04d-b6e34efa20f0 req-b97d553b-e6c8-4808-ad63-a9d995816377 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2085359
Jun 01 12:38:16.740987 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-b368cc33-81de-452f-8a12-8ed142a9b605 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:16.746117 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:16.757325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:16.847041 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:16.847644 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:16.847786 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25ce0190>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:16.848631 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Pushing event updated for resources: {'Port': ['ID=7b67088d-5113-4748-859f-22ad3e8702e9,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:16.851132 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:16.853747 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:16.855021 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:16.857463 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:16.878664 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group_rule and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:16.897782 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-17581c6f-afa1-4d4a-9170-c4314b81a702 req-2c1d8d82-b3c0-4b41-8184-2bc8d590a1fc tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.4216199
Jun 01 12:38:16.946393 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a05603f3-cbd7-4e24-a74e-e69f750b686f None None] Pushing event updated for resources: {'Port': ['ID=abab8eea-b119-4add-835f-fd819aeea2ce,revision_number=4']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:17.051177 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-a05603f3-cbd7-4e24-a74e-e69f750b686f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:17.101792 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:17.112993 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:17.166779 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.302092 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:17.312438 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.333790 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.338607 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-a48482f9-1db0-4b01-b1e6-5cdef881b0be tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:17.364369 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1fb85678-c033-49a9-9d95-b4981b00a7a1 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:17.394275 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8995ed00-ddb3-4335-8c9e-d854651b795d,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:17.400781 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:17.417626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.418816 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.8231866
Jun 01 12:38:17.419930 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.429202 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33048) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:17.440448 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:17.449216 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:17.455324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:floatingip and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:38:17.459002 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:38:17.473345 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:17.524737 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 1fb85678-c033-49a9-9d95-b4981b00a7a1 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:17.531351 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 1fb85678-c033-49a9-9d95-b4981b00a7a1 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:17.532321 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.544916 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.582021 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.659608 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.691040 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.727403 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 1fb85678-c033-49a9-9d95-b4981b00a7a1, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=1fb85678-c033-49a9-9d95-b4981b00a7a1,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:17.737572 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.739041 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5b0a906d-d514-4e3a-8cab-b34537beb9a5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:17.772307 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:17.873855 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cf7dc99-bbf3-460f-9f1f-d51e6de0d546 None None] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:38:17.876868 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25ce0190>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:16Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:17.882487 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b9d4064-5d14-4d58-9d15-f1ddf2940709 None None] The sync data for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi is: [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:16Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:17.960474 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.973198 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:17.979179 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:18.002923 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=1fb85678-c033-49a9-9d95-b4981b00a7a1,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:18.015749 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:18.051056 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Provisioning for port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:18.058198 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:18.064636 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event updated for resources: {'Port': ['ID=cabbdb3b-99a1-4827-8288-2d2bc4e300a8,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:18.066062 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Provisioning complete for port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:18.066630 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.068790 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.073443 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:18.129792 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:18.130473 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.214986 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.274919 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1978751', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1981391'] for router, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.358715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40067f66-c579-48c4-811c-ccb6226fb8fa req-18ac2c47-2a68-4723-90bd-dd0ffccd0a14 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:18.382583 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-40067f66-c579-48c4-811c-ccb6226fb8fa req-18ac2c47-2a68-4723-90bd-dd0ffccd0a14 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.3191266
Jun 01 12:38:18.441069 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.l3_db [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Floating IP ec3f8f9f-443d-4cee-bb11-2ec992472a3a associated. External IP: 172.27.3.155, port: db567b77-bbc1-4e8f-95eb-46817c3ec9d6.
Jun 01 12:38:18.490755 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.506510 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.567972 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] For port 5b0a906d-d514-4e3a-8cab-b34537beb9a5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=5b0a906d-d514-4e3a-8cab-b34537beb9a5,segment=NetworkSegment(d157676f-795c-471e-8e61-958dc1e2cb97),segment_id=d157676f-795c-471e-8e61-958dc1e2cb97)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:18.581737 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.584458 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:18.597101 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-40067f66-c579-48c4-811c-ccb6226fb8fa req-22635709-b3bb-450d-abe4-4afb1241eac1 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1995432
Jun 01 12:38:18.646968 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 is scheduled to L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a with binding_index 1 {{(pid=91979) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
Jun 01 12:38:18.652928 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Allocated IP 172.27.3.181 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/b3ee8d29-83cb-4f24-99f8-c93f41450f0d) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:18.716161 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.db.api [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=91980) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
Jun 01 12:38:18.716583 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_db.api [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
Jun 01 12:38:18.720390 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Pushing event updated for resources: {'Port': ['ID=5b0a906d-d514-4e3a-8cab-b34537beb9a5,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:18.723632 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:18.865060 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:18.875695 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Sync routers for ids ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:18.885720 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Routers {'29fa0bf2-324b-44b6-bfd3-c2d0020158d5'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:18.886413 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a24faa940>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:18.893232 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Notify callbacks [] for router, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:18.897206 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 4.9391100
Jun 01 12:38:18.897405 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33056) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:18.986302 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-9061bf37-a684-44fa-9ab1-7689648bf48c None None] Provisioning complete for port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:18.986673 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9061bf37-a684-44fa-9ab1-7689648bf48c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.111116 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.148811 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Set router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:19.164323 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Router 25520016-154b-4bde-8e0c-2e8576327298 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:38:19.274770 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.331626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f036bbf4-4125-4d5f-96ad-da74412b492f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:19.413463 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:19.419417 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:19.427890 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:19.434054 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:19.516316 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:19.528438 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] Sync routers for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:19.546259 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:19.547020 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b2acd0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:19.551885 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'Port': ['ID=b3ee8d29-83cb-4f24-99f8-c93f41450f0d,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:19.592461 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:19.593032 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.622300 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.629422 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:19.710635 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a24faa940>, [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 3, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port': {'id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:de:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:15Z', 'updated_at': '2021-06-01T12:38:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:19.730415 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Checking router: 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:19.730769 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Updating router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 port 7b67088d-5113-4748-859f-22ad3e8702e9 binding host dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:38:19.747527 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.797224 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.802917 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:19.825069 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:19.889810 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-fb17228c-5457-4317-96b0-83fbffc38680 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 5.0429342
Jun 01 12:38:19.893467 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6'}] {{(pid=91978) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:19.895828 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08332f069cdff5b13479b061d6bbe376049db186f7bff4c04e61a4b86035db55" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761" -d '{"events": [{"name": "network-changed", "server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6"}]}' {{(pid=91978) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:19.983529 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa7c6f15-0691-4af8-9b33-258a0f527cf9 x-openstack-request-id: req-aa7c6f15-0691-4af8-9b33-258a0f527cf9 {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:19.984127 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6", "status": "completed", "code": 200}]} {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:19.984646 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-aa7c6f15-0691-4af8-9b33-258a0f527cf9 {{(pid=91978) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:19.985232 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'status': 'completed', 'code': 200}
Jun 01 12:38:19.993493 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.129688 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1fb85678-c033-49a9-9d95-b4981b00a7a1 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:20.182102 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.191499 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.206680 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:20.233547 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-d50b7be1-1189-4982-8ea1-dc74146be816 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:20.235025 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-d50b7be1-1189-4982-8ea1-dc74146be816 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1098 time: 0.2304552
Jun 01 12:38:20.266377 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 1fb85678-c033-49a9-9d95-b4981b00a7a1 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:20.266732 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.304384 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b2acd0>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'ec3f8f9f-443d-4cee-bb11-2ec992472a3a', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'floating_ip_address': '172.27.3.155', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '25520016-154b-4bde-8e0c-2e8576327298', 'port_id': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 541, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'mac_address': 'fa:16:3e:1a:fe:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:38:17Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 0, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:17Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:20.310001 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] Checking router: 25520016-154b-4bde-8e0c-2e8576327298 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:20.322690 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:20.324015 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b2acd0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:20.340884 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'Port': ['ID=b3ee8d29-83cb-4f24-99f8-c93f41450f0d,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:20.345643 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:20.348758 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.370167 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.379790 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 2.9426353
Jun 01 12:38:20.431025 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Notify callbacks [] for port, precommit_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.460660 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-65fb9fea-e9af-4733-a40e-e63b33a486ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:20.462936 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-65fb9fea-e9af-4733-a40e-e63b33a486ff service neutron] 10.222.0.95 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 907 time: 0.2118502
Jun 01 12:38:20.488711 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Transition to ACTIVE for port object 7b67088d-5113-4748-859f-22ad3e8702e9 will not be triggered until provisioned by entity L2. {{(pid=91980) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:20.504724 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.508457 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-c4a87f9e-5827-4ad9-9065-eb08f3b47781 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:20.538910 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5b0a906d-d514-4e3a-8cab-b34537beb9a5 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:20.552102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Allocated IP 172.20.0.1 (0c0b6436-f8c8-4324-8b99-db3df38ef70c/af328333-62ea-4d73-aa26-e559eeb285f9/04679eb3-3be3-4918-9f07-899ce27566e8) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:20.570978 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:20.643132 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Attempting to bind port 7b67088d-5113-4748-859f-22ad3e8702e9 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:20.643622 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Attempting to bind port 7b67088d-5113-4748-859f-22ad3e8702e9 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:20.643968 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Attempting to bind port 7b67088d-5113-4748-859f-22ad3e8702e9 on network 44ed28c8-c80a-4954-a823-abbd3f7966bf {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:20.647369 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3c95b4c-0cef-4d5c-9f43-244e3b47e804 None None] Pushing event updated for resources: {'Port': ['ID=7b67088d-5113-4748-859f-22ad3e8702e9,revision_number=2']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:20.652090 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-c3c95b4c-0cef-4d5c-9f43-244e3b47e804 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:20.658653 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 38, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:20.659983 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Checking segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91980) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:20.660338 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.660819 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Bound using segment: {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'} {{(pid=91980) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:20.661388 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.managers [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Bound port: 7b67088d-5113-4748-859f-22ad3e8702e9, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e393528e-e6c5-4c07-9e73-e139b99685c7', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}}] {{(pid=91980) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:20.661796 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.711610 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-ba733e4a-6c06-4dd4-86f9-104ce42cab43 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:20.715139 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-f2d5f0f1-f60c-4756-b8de-470f5970fb59 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 999 time: 0.2440062
Jun 01 12:38:20.734704 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:20.735670 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.785964 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-ba733e4a-6c06-4dd4-86f9-104ce42cab43 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:20.793512 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-ba733e4a-6c06-4dd4-86f9-104ce42cab43 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--721976937&fields=id&tenant_id=dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 267 time: 0.2433021
Jun 01 12:38:20.794191 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] For port 7b67088d-5113-4748-859f-22ad3e8702e9, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91980) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:20.807560 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] For port 7b67088d-5113-4748-859f-22ad3e8702e9, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=7b67088d-5113-4748-859f-22ad3e8702e9,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:20.815917 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.820086 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:20.935030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-d596b19e-959e-4da3-81c1-4e1913a2a3f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:20.936598 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-d596b19e-959e-4da3-81c1-4e1913a2a3f0 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 200  len: 845 time: 0.1951320
Jun 01 12:38:20.953518 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Routers {'29fa0bf2-324b-44b6-bfd3-c2d0020158d5'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:20.954148 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a24faa940>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:20.991835 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:20.993780 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b2acd0>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'ec3f8f9f-443d-4cee-bb11-2ec992472a3a', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'floating_ip_address': '172.27.3.155', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '25520016-154b-4bde-8e0c-2e8576327298', 'port_id': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 541, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'mac_address': 'fa:16:3e:1a:fe:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:38:17Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 0, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:17Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:20.997953 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e47e1c-23c1-4fbf-848a-6fbc0d345081 None None] The sync data for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi is: [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'ec3f8f9f-443d-4cee-bb11-2ec992472a3a', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'floating_ip_address': '172.27.3.155', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '25520016-154b-4bde-8e0c-2e8576327298', 'port_id': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 541, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'mac_address': 'fa:16:3e:1a:fe:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:38:17Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 0, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:17Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:21.018902 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3c95b4c-0cef-4d5c-9f43-244e3b47e804 None None] Pushing event updated for resources: {'Port': ['ID=7b67088d-5113-4748-859f-22ad3e8702e9,revision_number=3']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:21.022024 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-c3c95b4c-0cef-4d5c-9f43-244e3b47e804 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:21.023545 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device abab8eea-b119-4add-835f-fd819aeea2ce up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:21.061711 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Transition to ACTIVE for port object 04679eb3-3be3-4918-9f07-899ce27566e8 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:21.083030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-d3b87c72-7545-4e04-b64c-985ae3a613f0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:21.083719 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-d3b87c72-7545-4e04-b64c-985ae3a613f0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:network {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:21.120577 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-d3b87c72-7545-4e04-b64c-985ae3a613f0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:network {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:21.126158 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-d3b87c72-7545-4e04-b64c-985ae3a613f0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 816 time: 0.3317964
Jun 01 12:38:21.136892 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-165d125a-200a-4cef-9fdf-edcd8573c38e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:21.138082 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-165d125a-200a-4cef-9fdf-edcd8573c38e service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=8c58f5e9-2554-475d-a254-a02b35fda51b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1911097
Jun 01 12:38:21.143356 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-63a94bcd-814e-43d1-bddd-2775724fb887 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/quotas/dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 375 time: 0.0163331
Jun 01 12:38:21.146073 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:21.154245 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5ac9a7ce-d736-4ceb-8db0-6d371cec4279 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:21.204137 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port abab8eea-b119-4add-835f-fd819aeea2ce completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:21.208342 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] Set router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:21.253327 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7a74e8f-bb13-484e-9580-b03ed3522fcc None None] New status for floating IP ec3f8f9f-443d-4cee-bb11-2ec992472a3a: ACTIVE {{(pid=91980) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:38:21.375938 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port abab8eea-b119-4add-835f-fd819aeea2ce triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:21.376317 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:21.441134 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:21.451049 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:21.465450 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:21.496377 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Pushing event updated for resources: {'Port': ['ID=04679eb3-3be3-4918-9f07-899ce27566e8,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:21.506584 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.352s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:21.561628 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1978046'] for router_interface, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:21.583821 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-cbc0d4f7-8e61-41b2-9e44-6220a1c373d1 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4326169
Jun 01 12:38:21.628541 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-7b421835-5e97-48ba-af27-1cd4636276b2 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&fields=id HTTP/1.1" status: 200  len: 348 time: 0.4762230
Jun 01 12:38:21.871178 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-315c2d32-9e12-4bea-9583-e3f25ac60ed0 None None] Provisioning for port 04679eb3-3be3-4918-9f07-899ce27566e8 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:21.874780 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1f3c1e5c-6dd4-4ac9-a9b0-37c7211d6761 req-570b72ae-3498-4842-ada2-46d09d1af8a9 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2816656
Jun 01 12:38:21.876327 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:21.899386 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-315c2d32-9e12-4bea-9583-e3f25ac60ed0 None None] Provisioning complete for port 04679eb3-3be3-4918-9f07-899ce27566e8 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:21.899782 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-315c2d32-9e12-4bea-9583-e3f25ac60ed0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:21.899983 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-36a7d9d7-8d69-41c4-8a61-ed84d1c409cc service neutron] 10.222.0.81 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2545948
Jun 01 12:38:21.980708 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-315c2d32-9e12-4bea-9583-e3f25ac60ed0 None None] Port 04679eb3-3be3-4918-9f07-899ce27566e8 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:21.984774 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port abab8eea-b119-4add-835f-fd819aeea2ce, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=abab8eea-b119-4add-835f-fd819aeea2ce,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:21.993750 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:21.996155 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:22.051847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:22.054520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a24faa940>, [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 3, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port': {'id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:de:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:15Z', 'updated_at': '2021-06-01T12:38:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:22.064538 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02e57584-7b02-4f54-90ec-aed4d897c1fd None None] The sync data for ids ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'] in dv-cinder-793515-2-iscsi is: [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 3, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port': {'id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:de:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:15Z', 'updated_at': '2021-06-01T12:38:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:22.070592 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=abab8eea-b119-4add-835f-fd819aeea2ce,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:22.073939 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:22.153996 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-ab73c387-b4ea-4b89-bb5e-5f71347ade15 service neutron] 10.222.0.81 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2474749
Jun 01 12:38:22.379933 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-9763acd5-3056-4bf9-8905-701944abf7bf req-af76f89f-21f3-4c51-8f6d-8ee5216c0bab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:22.385991 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:22.392395 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:22.402795 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-9763acd5-3056-4bf9-8905-701944abf7bf req-af76f89f-21f3-4c51-8f6d-8ee5216c0bab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:22.405787 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9763acd5-3056-4bf9-8905-701944abf7bf req-af76f89f-21f3-4c51-8f6d-8ee5216c0bab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 210 time: 0.1046038
Jun 01 12:38:22.439144 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:22.524594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Pushing event updated for resources: {'Port': ['ID=04679eb3-3be3-4918-9f07-899ce27566e8,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:22.527065 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1581571', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1977875'] for router_interface, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:22.539973 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.540334 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.540744 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.541104 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.541437 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.541785 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.542263 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.542546 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.542803 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.543158 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.543467 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.543797 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:22.549460 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:22.688349 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:22.689605 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:22.910342 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:38:22.910739 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-af0cc04f-f986-4543-85d6-498fecc9f288 None None] Provisioning complete for port 04679eb3-3be3-4918-9f07-899ce27566e8 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:22.911266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-af0cc04f-f986-4543-85d6-498fecc9f288 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:22.970067 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-af0cc04f-f986-4543-85d6-498fecc9f288 None None] Port 04679eb3-3be3-4918-9f07-899ce27566e8 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:23.203141 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:23.211716 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] 10.222.0.81 "PUT /v2.0/routers/29fa0bf2-324b-44b6-bfd3-c2d0020158d5/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.3132966
Jun 01 12:38:23.632312 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-39343039-5b5c-4765-ad52-0c5dbfca34b6 req-ba14c190-79f8-4faa-a496-ae3b6e2a4372 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 210 time: 0.0650122
Jun 01 12:38:23.692131 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-d59dd6a2-5feb-4f1a-aca5-d43d9fa4f015 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:23.693674 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-d59dd6a2-5feb-4f1a-aca5-d43d9fa4f015 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 816 time: 0.2223890
Jun 01 12:38:23.755902 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-cebedb84-f7f8-4414-8a55-7be82f7cb8f0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 379 time: 0.0440278
Jun 01 12:38:23.770876 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'port': {'device_id': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'admin_state_up': True, 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'security_groups': ['3bc3847f-727c-4094-9173-73ca49a9dc5e']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:23.914931 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:23.925731 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:23.936961 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Made reservation on behalf of dc771aee219e4d5d914602852a126ac3 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:38:23.940698 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:24.142801 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Allocated IP 172.20.0.9 (a2f45554-20a3-4b02-a9ad-473554e8b2ed/37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5/dd8500c8-5962-4478-9c99-20281668d7c6) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:24.207661 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 7b67088d-5113-4748-859f-22ad3e8702e9 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:24.224347 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Sync routers for ids ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:24.237431 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Routers {'29fa0bf2-324b-44b6-bfd3-c2d0020158d5'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:24.238697 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e187c0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:24.377823 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 7b67088d-5113-4748-859f-22ad3e8702e9 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:24.392559 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 7b67088d-5113-4748-859f-22ad3e8702e9 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:24.392945 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:24.443121 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:24.462268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Transition to ACTIVE for port object dd8500c8-5962-4478-9c99-20281668d7c6 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:24.487836 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Set router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:24.506529 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:24.513507 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4b54bf5a-fea0-4dcf-b10f-f4c84370b004 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:24.558786 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:24.580613 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 7b67088d-5113-4748-859f-22ad3e8702e9, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=7b67088d-5113-4748-859f-22ad3e8702e9,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:24.587379 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:24.588739 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device abab8eea-b119-4add-835f-fd819aeea2ce up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:24.596824 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:24.599800 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:24.601994 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:24.603179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:24.605467 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:24.637351 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:24.715972 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:24.718469 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:24.776321 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0089254
Jun 01 12:38:24.790729 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Request body: {'port': {'device_id': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:24.806480 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=7b67088d-5113-4748-859f-22ad3e8702e9,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:24.809895 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:24.832866 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port abab8eea-b119-4add-835f-fd819aeea2ce triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:24.833128 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.006860 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00b4210-e59d-4582-bfa1-0cf29de89671 req-efb75a0d-4e6b-4032-8332-00dab1ddbcb3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:25.009409 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e00b4210-e59d-4582-bfa1-0cf29de89671 req-efb75a0d-4e6b-4032-8332-00dab1ddbcb3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 931 time: 0.1445310
Jun 01 12:38:25.018385 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.051865 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-3de04d25-881a-4f51-bfef-662c08921d31 None None] Provisioning for port dd8500c8-5962-4478-9c99-20281668d7c6 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:25.058497 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-3de04d25-881a-4f51-bfef-662c08921d31 None None] Provisioning complete for port dd8500c8-5962-4478-9c99-20281668d7c6 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:25.058716 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-3de04d25-881a-4f51-bfef-662c08921d31 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.079224 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e187c0>, [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 4, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port': {'id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:de:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:15Z', 'updated_at': '2021-06-01T12:38:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '04679eb3-3be3-4918-9f07-899ce27566e8', 'name': '', 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'mac_address': 'fa:16:3e:01:3a:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'af328333-62ea-4d73-aa26-e559eeb285f9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:20Z', 'updated_at': '2021-06-01T12:38:22Z', 'revision_number': 2, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'subnets': [{'id': 'af328333-62ea-4d73-aa26-e559eeb285f9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:25.090953 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Checking router: 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:25.091378 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-e00b4210-e59d-4582-bfa1-0cf29de89671 req-a614a52e-93c7-43b5-bb3b-d6cc3c92b128 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:25.091541 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Updating router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 port 04679eb3-3be3-4918-9f07-899ce27566e8 binding host dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
Jun 01 12:38:25.104689 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-e00b4210-e59d-4582-bfa1-0cf29de89671 req-a614a52e-93c7-43b5-bb3b-d6cc3c92b128 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:25.106235 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e00b4210-e59d-4582-bfa1-0cf29de89671 req-a614a52e-93c7-43b5-bb3b-d6cc3c92b128 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0906610
Jun 01 12:38:25.139074 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-3de04d25-881a-4f51-bfef-662c08921d31 None None] Port dd8500c8-5962-4478-9c99-20281668d7c6 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:25.187024 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.503658 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dd8500c8-5962-4478-9c99-20281668d7c6 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:38:25.511325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.529724 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Transition to ACTIVE for port object dd8500c8-5962-4478-9c99-20281668d7c6 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:25.535836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.550734 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:25.614425 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Notify callbacks [] for port, precommit_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.628590 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.provisioning_blocks [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Transition to ACTIVE for port object 04679eb3-3be3-4918-9f07-899ce27566e8 will not be triggered until provisioned by entity L2. {{(pid=91981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:25.641429 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.657407 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-5bdcccd6-dbc4-40d0-a3fb-2b6a99044086 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:25.749250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:25.944933 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92b40e9-be85-4b2e-864a-4d6ae22ca7ba None None] Pushing event updated for resources: {'Port': ['ID=04679eb3-3be3-4918-9f07-899ce27566e8,revision_number=3']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:25.953688 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-c92b40e9-be85-4b2e-864a-4d6ae22ca7ba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:25.976254 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Attempting to bind port 04679eb3-3be3-4918-9f07-899ce27566e8 on host dv-cinder-793515-2-iscsi for vnic_type normal with profile  {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:25.976853 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Attempting to bind port 04679eb3-3be3-4918-9f07-899ce27566e8 by drivers openvswitch,hyperv on host dv-cinder-793515-2-iscsi at level 0 using segments [{'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:25.977324 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Attempting to bind port 04679eb3-3be3-4918-9f07-899ce27566e8 on network 0c0b6436-f8c8-4324-8b99-db3df38ef70c {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:25.984134 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Checking agent: {'id': 'ccf25f48-d17e-4ca7-bdee-6d0d016b148a', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-793515-2-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 26, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 27, 12), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 38, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-793515-2-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:25.984715 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Checking segment: {'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:25.985216 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:25.985706 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Bound using segment: {'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'} {{(pid=91981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:25.986302 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.managers [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Bound port: 04679eb3-3be3-4918-9f07-899ce27566e8, host: dv-cinder-793515-2-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd157676f-795c-471e-8e61-958dc1e2cb97', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 750, 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c'}}] {{(pid=91981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:25.986863 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:26.011107 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.460s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:26.041705 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Attempting to bind port dd8500c8-5962-4478-9c99-20281668d7c6 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:26.042132 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Attempting to bind port dd8500c8-5962-4478-9c99-20281668d7c6 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:26.042552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Attempting to bind port dd8500c8-5962-4478-9c99-20281668d7c6 on network a2f45554-20a3-4b02-a9ad-473554e8b2ed {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:26.049419 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Port dd8500c8-5962-4478-9c99-20281668d7c6 on network a2f45554-20a3-4b02-a9ad-473554e8b2ed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:38:26.049854 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Attempting to bind port dd8500c8-5962-4478-9c99-20281668d7c6 on network a2f45554-20a3-4b02-a9ad-473554e8b2ed {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:26.056333 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 38, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:26.056909 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Checking segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:26.064558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Bound using segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:26.064558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Bound port: dd8500c8-5962-4478-9c99-20281668d7c6, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:26.064558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:26.101000 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] For port 04679eb3-3be3-4918-9f07-899ce27566e8, host dv-cinder-793515-2-iscsi, cleared binding levels {{(pid=91981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:26.102136 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 7b67088d-5113-4748-859f-22ad3e8702e9 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:26.105082 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.plugins.ml2.db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] For port 04679eb3-3be3-4918-9f07-899ce27566e8, host dv-cinder-793515-2-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=04679eb3-3be3-4918-9f07-899ce27566e8,segment=NetworkSegment(d157676f-795c-471e-8e61-958dc1e2cb97),segment_id=d157676f-795c-471e-8e61-958dc1e2cb97)] {{(pid=91981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:26.111026 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron_lib.callbacks.manager [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:26.126588 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:26.205711 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:26.208421 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 7b67088d-5113-4748-859f-22ad3e8702e9 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:26.208954 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:26.209875 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:26.218518 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:26.225554 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f190094e-4993-40d0-ba0c-c923cdfd86f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:26.277497 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Routers {'29fa0bf2-324b-44b6-bfd3-c2d0020158d5'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:26.278118 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e187c0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:26.340308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:26.363395 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:26.415392 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92b40e9-be85-4b2e-864a-4d6ae22ca7ba None None] Pushing event updated for resources: {'Port': ['ID=04679eb3-3be3-4918-9f07-899ce27566e8,revision_number=4']} {{(pid=91981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:26.435167 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG oslo_concurrency.lockutils [None req-c92b40e9-be85-4b2e-864a-4d6ae22ca7ba None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.308s {{(pid=91981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:26.449257 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:26.450117 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:26.451950 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] 10.222.0.95 "PUT /v2.0/ports/dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 200  len: 1093 time: 1.6666489
Jun 01 12:38:26.452672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:26.455146 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbd0afc0-423a-4001-9e0c-cbc871fdd330" -d '{"events": [{"name": "network-changed", "server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:26.572828 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6d7d9125-9a8d-4301-9d19-304d4debb06e x-openstack-request-id: req-6d7d9125-9a8d-4301-9d19-304d4debb06e {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:26.573409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:26.573409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-6d7d9125-9a8d-4301-9d19-304d4debb06e {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:26.573818 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'status': 'completed', 'code': 200}
Jun 01 12:38:26.594372 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba9dfa72-46a3-4abb-8c6c-ac0e642e1b94 req-85b700a1-4a75-43a6-ad1e-5fefd4198fc5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:26.595263 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ba9dfa72-46a3-4abb-8c6c-ac0e642e1b94 req-85b700a1-4a75-43a6-ad1e-5fefd4198fc5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:26.638053 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-a8566d14-e50f-4920-84d3-b4b58bc685d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:26.639977 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-a8566d14-e50f-4920-84d3-b4b58bc685d5 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1096 time: 0.1392479
Jun 01 12:38:26.641200 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ba9dfa72-46a3-4abb-8c6c-ac0e642e1b94 req-85b700a1-4a75-43a6-ad1e-5fefd4198fc5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:26.648277 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ba9dfa72-46a3-4abb-8c6c-ac0e642e1b94 req-85b700a1-4a75-43a6-ad1e-5fefd4198fc5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.2999957
Jun 01 12:38:26.648563 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] Set router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:26.744216 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-4620c271-940e-4944-af54-c526855c76bc service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 200  len: 217 time: 0.0811980
Jun 01 12:38:26.779426 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ba9dfa72-46a3-4abb-8c6c-ac0e642e1b94 req-d27b252f-78ac-44fb-994d-9a40a28fde92 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1300876
Jun 01 12:38:26.860282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-bb49d30a-8320-44a3-bb2b-99e7d78d1812 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:26.861948 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-bb49d30a-8320-44a3-bb2b-99e7d78d1812 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0962536
Jun 01 12:38:26.957871 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-6d0fd539-864d-4a4f-bd8f-e1c2f7a16ff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:26.959778 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-6d0fd539-864d-4a4f-bd8f-e1c2f7a16ff3 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0867929
Jun 01 12:38:27.046146 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e187c0>, [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 4, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port': {'id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:de:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:15Z', 'updated_at': '2021-06-01T12:38:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '04679eb3-3be3-4918-9f07-899ce27566e8', 'name': '', 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'mac_address': 'fa:16:3e:01:3a:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'af328333-62ea-4d73-aa26-e559eeb285f9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:20Z', 'updated_at': '2021-06-01T12:38:26Z', 'revision_number': 4, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'subnets': [{'id': 'af328333-62ea-4d73-aa26-e559eeb285f9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:27.050674 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a83dc324-e3b8-4ff6-a6c9-cf75c26fd381 None None] The sync data for ids ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'] in dv-cinder-793515-2-iscsi is: [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 4, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port': {'id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:de:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:15Z', 'updated_at': '2021-06-01T12:38:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '04679eb3-3be3-4918-9f07-899ce27566e8', 'name': '', 'network_id': '0c0b6436-f8c8-4324-8b99-db3df38ef70c', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'mac_address': 'fa:16:3e:01:3a:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 545, 'fixed_ips': [{'subnet_id': 'af328333-62ea-4d73-aa26-e559eeb285f9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:20Z', 'updated_at': '2021-06-01T12:38:26Z', 'revision_number': 4, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'subnets': [{'id': 'af328333-62ea-4d73-aa26-e559eeb285f9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:27.164987 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-cedeb0a0-4add-45dc-ab43-767c46c13030 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1978340
Jun 01 12:38:27.355814 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e43e0a87-1ac9-4fb4-a522-78d9c2e92c28 req-ff12746d-fee4-45b0-9ece-22a4036c7ec4 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1779165
Jun 01 12:38:27.563167 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-1891e20d-110a-4016-b49d-d969eccfeca0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:27.565682 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-1891e20d-110a-4016-b49d-d969eccfeca0 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1096 time: 0.1483381
Jun 01 12:38:27.733636 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-fbe860ae-9d34-4184-8833-c7f91cc423b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:27.735075 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-fbe860ae-9d34-4184-8833-c7f91cc423b9 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.1535628
Jun 01 12:38:27.832220 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-54261e3d-6bb6-495b-85d9-a783681a7413 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 200  len: 217 time: 0.0839808
Jun 01 12:38:27.931296 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-899e19c8-7465-4ca5-b77f-65261434a0d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:27.933026 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-899e19c8-7465-4ca5-b77f-65261434a0d6 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0926795
Jun 01 12:38:28.031992 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-ed26d1cb-1967-4a6a-ac29-7e7b6e04d2d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:28.036914 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-ed26d1cb-1967-4a6a-ac29-7e7b6e04d2d6 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0914133
Jun 01 12:38:28.072179 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e9671f9-6e35-416c-acb5-25a3d42c7d38 req-fb32d6f7-6f37-45a7-bd14-bc4fd6936c3e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:28.081612 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9e9671f9-6e35-416c-acb5-25a3d42c7d38 req-fb32d6f7-6f37-45a7-bd14-bc4fd6936c3e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.1342013
Jun 01 12:38:28.146804 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9e9671f9-6e35-416c-acb5-25a3d42c7d38 req-a20b2832-13e9-481e-9b00-702ce71adfe4 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0535414
Jun 01 12:38:28.166759 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 04679eb3-3be3-4918-9f07-899ce27566e8 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:28.220353 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-512467ab-6816-447f-8f2b-0354f774d92c service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1768689
Jun 01 12:38:28.257445 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning for port 04679eb3-3be3-4918-9f07-899ce27566e8 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:28.262757 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 04679eb3-3be3-4918-9f07-899ce27566e8 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:28.263138 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:28.427857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:28.469342 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] For port 04679eb3-3be3-4918-9f07-899ce27566e8, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=04679eb3-3be3-4918-9f07-899ce27566e8,segment=NetworkSegment(d157676f-795c-471e-8e61-958dc1e2cb97),segment_id=d157676f-795c-471e-8e61-958dc1e2cb97)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:28.477323 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:28.477953 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cbd0afc0-423a-4001-9e0c-cbc871fdd330 req-8ebbcbae-7ee0-49f1-8df9-d1857eed6357 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2490745
Jun 01 12:38:28.479325 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-16b5c2cc-1e8e-45c2-9d7e-2ca48b4c154d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:28.557136 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Pushing event updated for resources: {'Port': ['ID=04679eb3-3be3-4918-9f07-899ce27566e8,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:28.560089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:29.346732 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d0f386-931f-47fd-8989-c70332933126 req-fa67d013-d83b-4cd0-8e26-c4ee259fdab1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:29.348248 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d3d0f386-931f-47fd-8989-c70332933126 req-fa67d013-d83b-4cd0-8e26-c4ee259fdab1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0867085
Jun 01 12:38:29.395748 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d3d0f386-931f-47fd-8989-c70332933126 req-4daef11a-8a61-42c4-bf8e-5923572cc411 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411685
Jun 01 12:38:29.510456 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:38:29.660137 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:29.674377 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'port_id': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'mac_address': 'fa:16:3e:ed:6f:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 756, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:38:29.745987 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:29.806886 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dd8500c8-5962-4478-9c99-20281668d7c6 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:38:29.824401 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:29.830122 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:29.832691 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-da85d864-63a6-4c93-b48a-bd57553c70ed None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:29.908784 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:29.912303 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:30.082326 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 04679eb3-3be3-4918-9f07-899ce27566e8 up at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:30.116999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['dd8500c8-5962-4478-9c99-20281668d7c6'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:38:30.232634 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Provisioning complete for port 04679eb3-3be3-4918-9f07-899ce27566e8 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:30.232953 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:30.604229 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2667cad2-e9e9-47e5-b501-80fa8c2ae2f5 req-ecbf59aa-89ab-4a3b-b637-b59328bb87f1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:30.605998 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2667cad2-e9e9-47e5-b501-80fa8c2ae2f5 req-ecbf59aa-89ab-4a3b-b637-b59328bb87f1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 944 time: 0.0938747
Jun 01 12:38:30.657048 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2667cad2-e9e9-47e5-b501-80fa8c2ae2f5 req-0ab69652-552b-4f78-ac9a-7fd755380271 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436032
Jun 01 12:38:31.540004 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:31.624464 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port dd8500c8-5962-4478-9c99-20281668d7c6 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:31.632120 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port dd8500c8-5962-4478-9c99-20281668d7c6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:31.632486 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:31.789036 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:31.831903 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:31.833216 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:31.837643 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e697af23-6f15-4659-be0a-7e5832cf8385" -d '{"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-plugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:31.842463 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:31.846092 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-0ea2ccba-e14d-42ef-8cbf-1a3247aba0d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:31.878719 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b38116-d78d-4255-b7f9-1c6dd6173169 req-925df5ed-f27b-478f-a158-8dae7b5d009a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:31.887916 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-53b38116-d78d-4255-b7f9-1c6dd6173169 req-925df5ed-f27b-478f-a158-8dae7b5d009a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 944 time: 0.1043921
Jun 01 12:38:31.925453 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-457eab42-297e-456d-a9ae-c312e8860de8 x-openstack-request-id: req-457eab42-297e-456d-a9ae-c312e8860de8 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:31.926561 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-plugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:31.926561 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-457eab42-297e-456d-a9ae-c312e8860de8 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:31.926561 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'code': 200}
Jun 01 12:38:31.933989 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:31.949748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:31.963198 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-53b38116-d78d-4255-b7f9-1c6dd6173169 req-bf3d13cd-8cf3-437c-a157-91974822ed41 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0738287
Jun 01 12:38:32.200453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dcede80-31ad-42a6-96cc-55f4cf490a2c req-869ba040-b935-449d-8b24-f7b4a9783185 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:32.202137 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6dcede80-31ad-42a6-96cc-55f4cf490a2c req-869ba040-b935-449d-8b24-f7b4a9783185 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1098 time: 0.0825751
Jun 01 12:38:32.249333 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6dcede80-31ad-42a6-96cc-55f4cf490a2c req-27aa757d-f0e4-42e3-8182-cb31290e791d service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386117
Jun 01 12:38:33.212659 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee3fb58e-300d-4e5e-a7b1-9d6bbe4c3325 req-4f62838c-c7b8-4c79-936c-d5546d288d2a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:33.220998 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ee3fb58e-300d-4e5e-a7b1-9d6bbe4c3325 req-4f62838c-c7b8-4c79-936c-d5546d288d2a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1218555
Jun 01 12:38:33.307867 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ee3fb58e-300d-4e5e-a7b1-9d6bbe4c3325 req-dadbaa95-57a4-46ab-8ab6-a7f24c812e58 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0858142
Jun 01 12:38:34.598739 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-2768bc15-8619-4c41-99c3-352638cbf02d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:34.600074 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-2768bc15-8619-4c41-99c3-352638cbf02d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 815 time: 0.1597908
Jun 01 12:38:34.604963 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d821ab2b-b561-409f-873b-00179248d349 req-94b28014-ca13-4722-b657-4cbd96ab1894 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:34.606458 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d821ab2b-b561-409f-873b-00179248d349 req-94b28014-ca13-4722-b657-4cbd96ab1894 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1973920
Jun 01 12:38:34.614535 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-871143d1-2290-4413-b293-c33922ccb8b9 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/quotas/c9f26a8407554421b6fc3162658b8a00 HTTP/1.1" status: 200  len: 375 time: 0.0090032
Jun 01 12:38:34.650547 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d821ab2b-b561-409f-873b-00179248d349 req-c377be23-12e3-4666-ac72-f3dc17f3029f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386384
Jun 01 12:38:34.696793 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-14d318f3-b284-4594-96ab-d651aa8c52d4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Synchronizing usage tracker for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:34.713833 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-14d318f3-b284-4594-96ab-d651aa8c52d4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Unset dirty status for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:34.715092 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-14d318f3-b284-4594-96ab-d651aa8c52d4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0954866
Jun 01 12:38:34.835643 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a6eb803-3947-4fbb-8371-bc0d5ccf0836 req-cb00fb95-2b35-454e-977c-0ca9843ad378 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:34.837397 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0a6eb803-3947-4fbb-8371-bc0d5ccf0836 req-cb00fb95-2b35-454e-977c-0ca9843ad378 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0806046
Jun 01 12:38:34.845999 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33182) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:38:34.854039 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'floatingip': {'port_id': 'dd8500c8-5962-4478-9c99-20281668d7c6'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:34.924729 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-d0e45734-121f-4311-a971-da1e8db5351c service neutron] 10.222.0.81 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1979578
Jun 01 12:38:34.955770 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:35.219119 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-a003d98f-0550-4fa8-9694-23e75d6da752 service neutron] 10.222.0.81 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2869730
Jun 01 12:38:35.419023 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-67dffd87-1113-4632-ba1d-e571f0590567 req-17d0bdd3-db60-4811-b7e7-8d1176762ebd tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 210 time: 0.0464411
Jun 01 12:38:35.725604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:35.729354 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:35.908972 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Floating IP 28591775-0985-4a1c-ba11-27f697b7aac9 associated. External IP: 172.27.3.181, port: dd8500c8-5962-4478-9c99-20281668d7c6.
Jun 01 12:38:36.268653 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Router 7e176463-91d5-4735-ab79-0ea7c34c6767 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:38:36.603920 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc387ac8-d8de-4e56-924c-1dd5ba53077e req-b91d8bf2-e7fd-4f5e-97a0-c8a253591ee7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 210 time: 0.0675220
Jun 01 12:38:36.626205 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:38:36.626205 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:36.631188 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] Sync routers for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:38:36.641408 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:36.642025 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a26012250>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:36.720859 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-de47187d-53b9-47d8-b52b-e0083e4f3c1d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:36.722256 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-de47187d-53b9-47d8-b52b-e0083e4f3c1d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.95 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 815 time: 0.2878833
Jun 01 12:38:36.725508 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a8050691-59a8-4af3-9c49-bfd9851d2fa0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "PUT /v2.0/floatingips/28591775-0985-4a1c-ba11-27f697b7aac9 HTTP/1.1" status: 200  len: 991 time: 1.8785522
Jun 01 12:38:36.726317 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:36.728567 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95004378-f2f4-4b47-b802-721b065a40ca" -d '{"events": [{"name": "network-changed", "server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:36.735629 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'port': {'device_id': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'admin_state_up': True, 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:36.812978 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27427155-8f01-4732-a7d4-608a820b4302 x-openstack-request-id: req-27427155-8f01-4732-a7d4-608a820b4302 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:36.813599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:36.813891 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-27427155-8f01-4732-a7d4-608a820b4302 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:36.814313 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'status': 'completed', 'code': 200}
Jun 01 12:38:36.844140 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:36.948371 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:38:36.961883 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:38:36.974902 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95004378-f2f4-4b47-b802-721b065a40ca req-fe65862a-2555-490b-838f-24939f9ea635 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:36.976640 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-95004378-f2f4-4b47-b802-721b065a40ca req-fe65862a-2555-490b-838f-24939f9ea635 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1098 time: 0.1389718
Jun 01 12:38:36.977682 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Made reservation on behalf of c9f26a8407554421b6fc3162658b8a00 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:38:36.981322 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:37.353244 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95004378-f2f4-4b47-b802-721b065a40ca req-e04c83bd-3285-4baa-a73e-eb81761e8099 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:37.354861 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-95004378-f2f4-4b47-b802-721b065a40ca req-e04c83bd-3285-4baa-a73e-eb81761e8099 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.3620486
Jun 01 12:38:37.362577 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a26012250>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '28591775-0985-4a1c-ba11-27f697b7aac9', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'floating_ip_address': '172.27.3.181', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'port_id': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 544, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'mac_address': 'fa:16:3e:ed:6f:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:38:19Z', 'updated_at': '2021-06-01T12:38:35Z', 'revision_number': 1, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:37.370240 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] Checking router: 7e176463-91d5-4735-ab79-0ea7c34c6767 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:38:37.380323 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:38:37.381250 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a26012250>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 8},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:37.393794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Allocated IP 172.20.0.7 (a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1/6cb03821-94fa-4f9d-a846-04af6674699b/d93addc7-07f1-4d9e-8775-05a3301e8f0e) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:38:37.636940 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:37.650245 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:38:37.670873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Transition to ACTIVE for port object d93addc7-07f1-4d9e-8775-05a3301e8f0e will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:37.738258 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:37.747159 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-15309ea0-1bbb-4c45-92f8-1be2aa4f5ba5 tempest-ServerRescueNegativeTestJSON-1286710743 tempest-ServerRescueNegativeTestJSON-1286710743-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:37.875420 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:38:37.884734 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:38:37.891969 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:38:37.938357 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:37.948359 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:37.989821 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:37.990491 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:38.024294 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db873550-d0e4-4316-9238-9720438d1806 req-e16c3da1-fe42-45c4-99af-1de114e5def4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:38.025928 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-db873550-d0e4-4316-9238-9720438d1806 req-e16c3da1-fe42-45c4-99af-1de114e5def4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.2394218
Jun 01 12:38:38.164717 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4327374
Jun 01 12:38:38.173655 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-db873550-d0e4-4316-9238-9720438d1806 req-fad2939c-5b8c-4b64-80ca-a85046e66780 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1395886
Jun 01 12:38:38.188305 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a26012250>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '28591775-0985-4a1c-ba11-27f697b7aac9', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'floating_ip_address': '172.27.3.181', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'port_id': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 544, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'mac_address': 'fa:16:3e:ed:6f:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:38:19Z', 'updated_at': '2021-06-01T12:38:35Z', 'revision_number': 1, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:38:38.199182 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f20548f-7271-42dc-b2e7-566bafe8f0d4 None None] The sync data for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi is: [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '28591775-0985-4a1c-ba11-27f697b7aac9', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'floating_ip_address': '172.27.3.181', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'port_id': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 544, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'mac_address': 'fa:16:3e:ed:6f:77', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:38:19Z', 'updated_at': '2021-06-01T12:38:35Z', 'revision_number': 1, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:38:38.258562 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5824a3b8-76c5-4ca1-b3aa-b8348de82dd8 None None] Provisioning for port d93addc7-07f1-4d9e-8775-05a3301e8f0e completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:38.264415 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5824a3b8-76c5-4ca1-b3aa-b8348de82dd8 None None] Provisioning complete for port d93addc7-07f1-4d9e-8775-05a3301e8f0e triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:38.264850 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5824a3b8-76c5-4ca1-b3aa-b8348de82dd8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:38.329293 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-5824a3b8-76c5-4ca1-b3aa-b8348de82dd8 None None] Port d93addc7-07f1-4d9e-8775-05a3301e8f0e cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:38:38.445403 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54b3d480-6428-451b-a055-ce395b0b0aa3 None None] New status for floating IP 28591775-0985-4a1c-ba11-27f697b7aac9: ACTIVE {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:38:39.367626 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5884487-ac6e-47d4-9095-f623cc7566ca req-c243a31b-b87c-451f-aa2f-75dadd9d1807 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:39.368427 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-c5884487-ac6e-47d4-9095-f623cc7566ca req-c243a31b-b87c-451f-aa2f-75dadd9d1807 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Synchronizing usage tracker for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:39.386715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-c5884487-ac6e-47d4-9095-f623cc7566ca req-c243a31b-b87c-451f-aa2f-75dadd9d1807 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Unset dirty status for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:39.387973 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c5884487-ac6e-47d4-9095-f623cc7566ca req-c243a31b-b87c-451f-aa2f-75dadd9d1807 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.1044607
Jun 01 12:38:39.438913 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c5884487-ac6e-47d4-9095-f623cc7566ca req-b12fbb91-8788-4bea-b1ce-86e42d17f2ca tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0452201
Jun 01 12:38:39.843072 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-288bf8e5-7bcb-4ec1-b00a-fac1a02c2e2c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:40.632059 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9477867-9feb-464f-a4c6-141241b99557 req-f9d4bfa6-4763-4be9-b132-a7cd45a5a2fc tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:40.633573 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f9477867-9feb-464f-a4c6-141241b99557 req-f9d4bfa6-4763-4be9-b132-a7cd45a5a2fc tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.0846148
Jun 01 12:38:40.682917 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f9477867-9feb-464f-a4c6-141241b99557 req-628e1a9b-6cea-49b4-8b42-d6ca26f28ba9 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435321
Jun 01 12:38:41.885629 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e7964aa-b355-4778-a48f-c8c36b48ec82 req-4afeeace-be8b-438c-ad4a-800f8b971af4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:41.887155 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1e7964aa-b355-4778-a48f-c8c36b48ec82 req-4afeeace-be8b-438c-ad4a-800f8b971af4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.0947697
Jun 01 12:38:41.933260 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1e7964aa-b355-4778-a48f-c8c36b48ec82 req-67a06f25-d5a9-41fa-89dd-4d67c84f4053 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398014
Jun 01 12:38:42.074999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:42.324725 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:42.670141 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e6aa6fd4-8b02-4e0e-875c-49a2e56d2ba8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:43.149807 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f1cf17-b042-4f88-a762-a89c1d96080d req-4a03896f-e641-4bdf-80c1-4d505d2788fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:43.151370 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-14f1cf17-b042-4f88-a762-a89c1d96080d req-4a03896f-e641-4bdf-80c1-4d505d2788fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.0968571
Jun 01 12:38:43.198595 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-14f1cf17-b042-4f88-a762-a89c1d96080d req-7f89c3e4-4ea5-484f-8bb6-c3b45452419b tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409386
Jun 01 12:38:43.852501 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:44.395156 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d337fd-9e9e-4189-9d30-ae1c0024d47d req-0bf585d6-e78c-4992-a054-0e1a2423b225 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:44.396604 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-99d337fd-9e9e-4189-9d30-ae1c0024d47d req-0bf585d6-e78c-4992-a054-0e1a2423b225 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.0843558
Jun 01 12:38:44.444245 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-99d337fd-9e9e-4189-9d30-ae1c0024d47d req-9b3ac729-dd49-47fe-99a4-02827b9991b9 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417585
Jun 01 12:38:45.408239 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:45.649172 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24522084-8d52-48bd-8b30-2d61623b147a req-50e201d6-59e2-47db-8242-e077586b113c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:45.650684 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-24522084-8d52-48bd-8b30-2d61623b147a req-50e201d6-59e2-47db-8242-e077586b113c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.0874159
Jun 01 12:38:45.698051 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-24522084-8d52-48bd-8b30-2d61623b147a req-8c78905e-b9ba-4a95-92d4-96936021eee8 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409043
Jun 01 12:38:46.884735 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1701d52-69f7-46e7-9039-43f4d387b36b req-3b9d10fd-d455-4811-9b6e-86f3e9fc9781 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:46.886208 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b1701d52-69f7-46e7-9039-43f4d387b36b req-3b9d10fd-d455-4811-9b6e-86f3e9fc9781 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.0834639
Jun 01 12:38:46.937627 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b1701d52-69f7-46e7-9039-43f4d387b36b req-d356e391-ae15-478c-8484-a0ea12f019e6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455143
Jun 01 12:38:47.881508 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:38:48.123597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e344e954-55c1-4eb2-b7ef-951a50480e97 req-326c7907-de76-48c7-b88a-53b4ef0d2939 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:48.125115 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e344e954-55c1-4eb2-b7ef-951a50480e97 req-326c7907-de76-48c7-b88a-53b4ef0d2939 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 931 time: 0.0811596
Jun 01 12:38:48.169559 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e344e954-55c1-4eb2-b7ef-951a50480e97 req-368d033f-f591-4b68-aeba-e40fbdd524e5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383162
Jun 01 12:38:48.283159 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Request body: {'port': {'device_id': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:38:48.416221 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-a60dd4f6-13f8-4330-8303-59b77908c69e service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0699434
Jun 01 12:38:48.543641 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-95004378-f2f4-4b47-b802-721b065a40ca req-069b4cd7-72da-4b78-a765-f7918cf8b37f service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 200  len: 1001 time: 0.2359593
Jun 01 12:38:48.570956 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-5c97bf1f-c9d5-446b-8797-a31b49a619d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:48.572859 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-5c97bf1f-c9d5-446b-8797-a31b49a619d5 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 1098 time: 0.0808635
Jun 01 12:38:48.604268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:48.665480 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95004378-f2f4-4b47-b802-721b065a40ca req-f6f71128-9eb1-40f6-a639-728efc361502 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:48.667169 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-95004378-f2f4-4b47-b802-721b065a40ca req-f6f71128-9eb1-40f6-a639-728efc361502 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.1134927
Jun 01 12:38:48.722780 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-72a10284-1955-49bd-8e1f-49c2a1ce6148 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:48.724216 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-72a10284-1955-49bd-8e1f-49c2a1ce6148 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.1301253
Jun 01 12:38:48.817541 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95004378-f2f4-4b47-b802-721b065a40ca req-33ff935a-d9e5-4ae6-b16a-ef14734f6370 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:48.819002 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-95004378-f2f4-4b47-b802-721b065a40ca req-33ff935a-d9e5-4ae6-b16a-ef14734f6370 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1441846
Jun 01 12:38:48.826947 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-61964992-eb76-4b13-b96b-59f176149344 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 200  len: 1001 time: 0.0962868
Jun 01 12:38:48.892351 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-6f03286c-e50a-4234-bba0-d8f50c0de387 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:48.893926 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-6f03286c-e50a-4234-bba0-d8f50c0de387 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0598757
Jun 01 12:38:48.972880 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-73985a20-0da2-49e6-83d5-3f1979249ad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:48.974367 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-73985a20-0da2-49e6-83d5-3f1979249ad9 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0711586
Jun 01 12:38:49.059078 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-95004378-f2f4-4b47-b802-721b065a40ca req-20f79542-7e54-44d4-bad1-f88edbe03761 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2192864
Jun 01 12:38:49.108910 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-8c346ed3-b72b-4e28-99ce-aa19b8f0df26 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1257188
Jun 01 12:38:49.221362 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d93addc7-07f1-4d9e-8775-05a3301e8f0e {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:38:49.232315 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:49.256305 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9c2a142b-a8e3-4db7-8d68-be335846e5f0 req-14635605-36a6-4739-b1bb-b6e414689a57 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1404779
Jun 01 12:38:49.271908 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Transition to ACTIVE for port object d93addc7-07f1-4d9e-8775-05a3301e8f0e will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:38:49.278681 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-95004378-f2f4-4b47-b802-721b065a40ca req-afd9d2e8-a929-4040-81e9-cd8f6a54eb8d service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2042103
Jun 01 12:38:49.279486 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:49.284619 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-caf5642b-7cf1-4130-bd67-bd51c0a2b9ee tempest-VolumesActionsTest-621623351 tempest-VolumesActionsTest-621623351-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:49.462562 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Pushing event updated for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:49.491150 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:49.571621 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0aecb79-db9c-4849-b2b5-a4153f3b7a03 req-20dcd160-a0de-44f0-ba6f-4e0606da0a93 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:49.573090 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f0aecb79-db9c-4849-b2b5-a4153f3b7a03 req-20dcd160-a0de-44f0-ba6f-4e0606da0a93 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 943 time: 0.2896552
Jun 01 12:38:49.607143 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Attempting to bind port d93addc7-07f1-4d9e-8775-05a3301e8f0e on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:38:49.607464 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Attempting to bind port d93addc7-07f1-4d9e-8775-05a3301e8f0e by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:38:49.607783 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Attempting to bind port d93addc7-07f1-4d9e-8775-05a3301e8f0e on network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:49.621019 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Port d93addc7-07f1-4d9e-8775-05a3301e8f0e on network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:38:49.621339 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Attempting to bind port d93addc7-07f1-4d9e-8775-05a3301e8f0e on network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:38:49.633485 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 38, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:38:49.633808 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Checking segment: {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:38:49.634187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Bound using segment: {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:38:49.634608 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Bound port: d93addc7-07f1-4d9e-8775-05a3301e8f0e, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c18cba8e-a441-49ac-8933-33a840319416', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 758, 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:38:49.634950 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:49.649205 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f0aecb79-db9c-4849-b2b5-a4153f3b7a03 req-5b96914c-7317-463a-989d-001189914818 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0682220
Jun 01 12:38:49.728151 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:38:49.731834 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:38:49.736050 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:49.740495 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fdb49ec6-2ac8-46ba-b4d8-9bfbf53940de tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:49.798695 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:49.799304 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:49.800682 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] 10.222.0.95 "PUT /v2.0/ports/d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 1093 time: 1.5219185
Jun 01 12:38:49.801174 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:49.803426 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a" -d '{"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:49.823913 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Pushing event updated for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:49.827846 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:49.882845 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04d0f463-0509-462b-b3fe-12c548ea608d x-openstack-request-id: req-04d0f463-0509-462b-b3fe-12c548ea608d {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:49.883160 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:49.883439 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-04d0f463-0509-462b-b3fe-12c548ea608d {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:49.883855 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'status': 'completed', 'code': 200}
Jun 01 12:38:49.922302 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-c4ba29e7-9dac-42a8-a4ed-4958d668aba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:49.923790 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-c4ba29e7-9dac-42a8-a4ed-4958d668aba4 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1096 time: 0.0774326
Jun 01 12:38:49.998181 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-ac762dba-c2fd-484a-ad3e-e6c1cf0b6914 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 217 time: 0.0643752
Jun 01 12:38:50.066950 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-3f5365a0-51c7-4a95-84b7-387a13c63cd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:50.068390 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-3f5365a0-51c7-4a95-84b7-387a13c63cd9 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 200  len: 854 time: 0.0582561
Jun 01 12:38:50.148313 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-6f928421-fdff-4ff7-ac4c-70512f3b2c54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:50.149796 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-6f928421-fdff-4ff7-ac4c-70512f3b2c54 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0736499
Jun 01 12:38:50.364864 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-f8e13be2-90c3-4400-b5a5-baf213997b72 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2068136
Jun 01 12:38:50.509255 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-892ddf37-b7eb-453e-af9a-7fc2aa418c05 req-d378f21a-e6f3-4147-be92-5c0d46ca68a5 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1373794
Jun 01 12:38:50.633304 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-70f63bbb-4962-4635-ad73-a93432bf1c21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:50.634670 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-70f63bbb-4962-4635-ad73-a93432bf1c21 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1096 time: 0.0700173
Jun 01 12:38:50.766214 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-4f63bf76-4899-4eb1-9213-2ee2f631a1f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:50.767709 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-4f63bf76-4899-4eb1-9213-2ee2f631a1f0 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 916 time: 0.1251564
Jun 01 12:38:50.844363 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0efdae-9556-4e16-93e2-b062005d011b req-165e5d4b-d8d4-4c88-8b80-3a11c3b5ebc8 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:50.845988 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6e0efdae-9556-4e16-93e2-b062005d011b req-165e5d4b-d8d4-4c88-8b80-3a11c3b5ebc8 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 943 time: 0.0854950
Jun 01 12:38:50.846139 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-f60e6ff5-9266-4a7b-ae5c-d94683337bb0 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 217 time: 0.0706801
Jun 01 12:38:50.894851 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-6e0efdae-9556-4e16-93e2-b062005d011b req-a0f318f3-8f8a-4201-aa8b-c2c17fd65084 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Synchronizing usage tracker for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:38:50.912822 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-6e0efdae-9556-4e16-93e2-b062005d011b req-a0f318f3-8f8a-4201-aa8b-c2c17fd65084 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Unset dirty status for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:38:50.914006 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6e0efdae-9556-4e16-93e2-b062005d011b req-a0f318f3-8f8a-4201-aa8b-c2c17fd65084 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0625033
Jun 01 12:38:50.917836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-7f529c81-21bc-471a-9d2b-febe83bc0cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:50.920299 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-7f529c81-21bc-471a-9d2b-febe83bc0cb0 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 200  len: 854 time: 0.0662391
Jun 01 12:38:50.999560 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-ffa9e95e-a00d-4982-8dbd-6a04d2cf030d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:51.001017 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-ffa9e95e-a00d-4982-8dbd-6a04d2cf030d service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0734415
Jun 01 12:38:51.131457 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-c35b87ff-d1e8-427b-b81e-47cc0dd48738 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1222742
Jun 01 12:38:51.261745 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d7aedfe-c08f-4ed7-8ffc-b6aaa4750d9a req-f39a4b65-4648-4d7c-96c9-3dd407005086 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1238444
Jun 01 12:38:52.098656 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-823f6121-2c24-4779-811c-54a8087f3d38 req-a2581c8a-7d84-4554-b444-77656180ea51 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:52.100120 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-823f6121-2c24-4779-811c-54a8087f3d38 req-a2581c8a-7d84-4554-b444-77656180ea51 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 943 time: 0.0797098
Jun 01 12:38:52.148386 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-823f6121-2c24-4779-811c-54a8087f3d38 req-c22c8af8-9b64-4974-a8d4-e0fb97cee5ee tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425599
Jun 01 12:38:53.330037 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe93d5a-4067-4794-9803-e9de217a116d req-51f711d5-ff6e-4bd5-8432-75f0f7b17ce5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:53.331485 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfe93d5a-4067-4794-9803-e9de217a116d req-51f711d5-ff6e-4bd5-8432-75f0f7b17ce5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 943 time: 0.0795956
Jun 01 12:38:53.375714 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfe93d5a-4067-4794-9803-e9de217a116d req-65b849fe-423b-4497-b956-b691a0383df8 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386791
Jun 01 12:38:53.653168 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d93addc7-07f1-4d9e-8775-05a3301e8f0e details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:38:53.783468 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:53.796792 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'port_id': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'mac_address': 'fa:16:3e:56:f2:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 758, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:38:53.850144 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:53.867688 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d93addc7-07f1-4d9e-8775-05a3301e8f0e {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:38:53.883131 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:53.887353 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:53.890161 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-14e14336-3374-4ad5-b17e-dd0371cff754 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:53.960318 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:53.968013 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.968358 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.968716 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.971520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:38:53.975223 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:54.201923 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d93addc7-07f1-4d9e-8775-05a3301e8f0e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:38:54.566175 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec7b43b-20b5-4f80-acbd-86efec98beb4 req-193f33a9-876a-4fc5-bfdc-f9cd655a66e2 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:54.567621 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1ec7b43b-20b5-4f80-acbd-86efec98beb4 req-193f33a9-876a-4fc5-bfdc-f9cd655a66e2 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 944 time: 0.0822361
Jun 01 12:38:54.612375 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1ec7b43b-20b5-4f80-acbd-86efec98beb4 req-400b388b-cb00-4a60-88e3-ce0ea0759852 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387714
Jun 01 12:38:55.675943 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d93addc7-07f1-4d9e-8775-05a3301e8f0e up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:38:55.742648 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port d93addc7-07f1-4d9e-8775-05a3301e8f0e completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:38:55.747214 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port d93addc7-07f1-4d9e-8775-05a3301e8f0e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:38:55.747586 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:55.797540 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-462f1e86-c2b5-4b86-bba5-ef4e038a7ebb req-6a96e902-7cf4-44fe-bd33-f58a948986a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:55.798975 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-462f1e86-c2b5-4b86-bba5-ef4e038a7ebb req-6a96e902-7cf4-44fe-bd33-f58a948986a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 944 time: 0.0797448
Jun 01 12:38:55.843871 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-462f1e86-c2b5-4b86-bba5-ef4e038a7ebb req-8a4684a4-8d84-48b5-ae31-c8bc30501136 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392194
Jun 01 12:38:55.864479 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:55.891556 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:38:55.894161 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29a18a45-3ca1-4335-b0ff-4a06a45ef047" -d '{"events": [{"server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "name": "network-vif-plugged", "status": "completed", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:38:55.902016 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:38:55.906509 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:38:55.908481 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:38:55.942361 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:38:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-019ec12c-30c0-467b-a686-40b7e94c0868 x-openstack-request-id: req-019ec12c-30c0-467b-a686-40b7e94c0868 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:38:55.942655 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "name": "network-vif-plugged", "status": "completed", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:38:55.942908 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-019ec12c-30c0-467b-a686-40b7e94c0868 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:38:55.943289 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'code': 200}
Jun 01 12:38:55.975881 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:38:55.978760 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:38:56.175963 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aadfa4c0-3bb7-4012-948f-d4c360d73791 req-4cd2246b-4874-4147-8787-605d35d924f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:56.178503 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aadfa4c0-3bb7-4012-948f-d4c360d73791 req-4cd2246b-4874-4147-8787-605d35d924f8 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1098 time: 0.0710824
Jun 01 12:38:56.229893 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aadfa4c0-3bb7-4012-948f-d4c360d73791 req-b261d458-1e3b-4f4e-a132-6e193bb6ac1e service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0360999
Jun 01 12:38:57.036014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be9d66a-5946-411b-b9bf-f79965563ff3 req-2159c395-56f1-4a6d-8a76-17ea59537b36 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:57.037511 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7be9d66a-5946-411b-b9bf-f79965563ff3 req-2159c395-56f1-4a6d-8a76-17ea59537b36 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0850949
Jun 01 12:38:57.081761 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7be9d66a-5946-411b-b9bf-f79965563ff3 req-2adf076f-8125-4071-a9ae-41fc71e7f52d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385759
Jun 01 12:38:58.265375 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e52cc8-8457-4b50-983e-ab7595dc64f7 req-5cc3238f-e047-4afd-ae03-d261d93342aa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:58.266819 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83e52cc8-8457-4b50-983e-ab7595dc64f7 req-5cc3238f-e047-4afd-ae03-d261d93342aa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0800154
Jun 01 12:38:58.312184 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83e52cc8-8457-4b50-983e-ab7595dc64f7 req-60a8bef7-e71d-40c6-a40c-274b8c2377b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383930
Jun 01 12:38:58.506989 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6705aa24-4c8c-4737-8c1b-9e620fb914fc req-4cb98c87-f3b0-4244-84e9-03c7b9c2f869 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:58.508457 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6705aa24-4c8c-4737-8c1b-9e620fb914fc req-4cb98c87-f3b0-4244-84e9-03c7b9c2f869 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0838826
Jun 01 12:38:58.552057 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6705aa24-4c8c-4737-8c1b-9e620fb914fc req-d6a264d8-966b-4810-aa9f-2da4d85c4d80 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0373297
Jun 01 12:38:58.950950 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b65ddab6-ebaf-4b54-868c-4e7d5b9d145d req-e925c163-270d-422c-882b-af04802f0914 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:38:58.952334 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b65ddab6-ebaf-4b54-868c-4e7d5b9d145d req-e925c163-270d-422c-882b-af04802f0914 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0822718
Jun 01 12:38:58.996107 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b65ddab6-ebaf-4b54-868c-4e7d5b9d145d req-7888534d-4f63-4580-9afd-96bf8bf38e37 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380270
Jun 01 12:39:09.282564 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43ecb80-f87e-45f3-b9a3-e6e028b89d37 req-9d14fefe-28aa-4e42-8b3f-36f301a1efbc tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:09.283976 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d43ecb80-f87e-45f3-b9a3-e6e028b89d37 req-9d14fefe-28aa-4e42-8b3f-36f301a1efbc tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0819519
Jun 01 12:39:09.328147 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d43ecb80-f87e-45f3-b9a3-e6e028b89d37 req-42df4915-49f1-40c8-9284-99e685cd2a83 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385387
Jun 01 12:39:09.351221 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33364) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:09.465598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdf4ae5c-27b5-475f-82b2-68a696e119a7 tempest-TestMinimumBasicScenario-350559460 tempest-TestMinimumBasicScenario-350559460-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:09.466290 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-cdf4ae5c-27b5-475f-82b2-68a696e119a7 tempest-TestMinimumBasicScenario-350559460 tempest-TestMinimumBasicScenario-350559460-project-admin] Synchronizing usage tracker for tenant:d5d4ae84f265473eb98954af0f01a963 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:39:09.482107 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-cdf4ae5c-27b5-475f-82b2-68a696e119a7 tempest-TestMinimumBasicScenario-350559460 tempest-TestMinimumBasicScenario-350559460-project-admin] Unset dirty status for tenant:d5d4ae84f265473eb98954af0f01a963 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:39:09.483308 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-cdf4ae5c-27b5-475f-82b2-68a696e119a7 tempest-TestMinimumBasicScenario-350559460 tempest-TestMinimumBasicScenario-350559460-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1093 time: 0.1311016
Jun 01 12:39:09.486168 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33370) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:09.491186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'port_id': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'fixed_ip_address': '172.20.0.7'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:09.497649 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:09.501461 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:floatingip and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:09.504329 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:09.510018 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:09.521799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for floatingip, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:09.658813 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:09.845663 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-8d71f483-6417-4cd3-b51a-25d502d7759f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:09.875426 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Allocated IP 172.27.3.64 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/22d18bb8-1d34-4355-ab05-0c5b2926d395) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:39:10.018787 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:10.047945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:10.051598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7c7d9081-56e1-4905-bad6-a31afccc09a9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:10.115781 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:39:10.119441 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:39:10.123052 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:39:10.151066 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'Port': ['ID=22d18bb8-1d34-4355-ab05-0c5b2926d395,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:10.156938 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:10.521417 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:10.595473 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:10.796354 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:10.800985 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:10.804365 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:10.911600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'Port': ['ID=22d18bb8-1d34-4355-ab05-0c5b2926d395,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:10.915550 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:10.924935 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:11.091435 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Floating IP 45919513-0043-4aab-a6c6-b8268504d048 associated. External IP: 172.27.3.64, port: d93addc7-07f1-4d9e-8775-05a3301e8f0e.
Jun 01 12:39:11.523565 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Router 43f207c7-1198-400a-9361-6f9c7b4a3880 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:39:11.696706 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:39:11.707110 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] Sync routers for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:39:11.716748 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:39:11.717356 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b90820>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:11.721055 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:11.782590 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.2952964
Jun 01 12:39:11.783433 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:11.785253 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33378) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:11.787306 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df48b365-1633-44c5-aa3e-e00a60692633" -d '{"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:11.790866 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1566501766', 'description': 'tempest-secgroup-smoke-1566501766 description', 'project_id': 'c9f26a8407554421b6fc3162658b8a00'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:11.797726 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:11.807676 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:11.823636 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:11.832715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2dc25a0-6066-4298-8e00-2f6657d39e37 x-openstack-request-id: req-a2dc25a0-6066-4298-8e00-2f6657d39e37 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:11.833141 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:11.833519 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-a2dc25a0-6066-4298-8e00-2f6657d39e37 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:11.834092 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'status': 'completed', 'code': 200}
Jun 01 12:39:11.910509 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:39:11.935641 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df48b365-1633-44c5-aa3e-e00a60692633 req-53c7c032-745e-45fa-b11f-1af988ca5efd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:11.937741 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df48b365-1633-44c5-aa3e-e00a60692633 req-53c7c032-745e-45fa-b11f-1af988ca5efd service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1098 time: 0.0822546
Jun 01 12:39:11.944216 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:11.948372 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:11.951383 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:11.957342 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:12.034224 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.039462 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.045334 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:12.086673 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3d6313c3-d5a9-4821-91a9-8d9461d2e507,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:12.092967 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:12.099210 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.100573 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.3142133
Jun 01 12:39:12.103471 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33386) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:12.107966 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df48b365-1633-44c5-aa3e-e00a60692633 req-e83c2fec-8a88-46b5-a3fd-4844d4e142e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:12.109512 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df48b365-1633-44c5-aa3e-e00a60692633 req-e83c2fec-8a88-46b5-a3fd-4844d4e142e6 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 916 time: 0.1647675
Jun 01 12:39:12.109818 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'security_group_rule': {'security_group_id': '3d6313c3-d5a9-4821-91a9-8d9461d2e507', 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:12.116060 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:12.123156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:12.126399 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:12.132627 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:12.155822 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.161235 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.220320 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.221498 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df48b365-1633-44c5-aa3e-e00a60692633 req-a37decab-ffa1-4ffa-b0e0-cb113324daa5 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 998 time: 0.1036434
Jun 01 12:39:12.224731 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.226840 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-01fdfcb2-deb0-4850-a930-f94885b3e2a0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:12.249359 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aa001aae-617c-4823-aeb1-61493f7f68ce,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:12.251858 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:12.259028 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.260637 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1de7ff81-353b-41e9-b340-3c63f99e854d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1560888
Jun 01 12:39:12.263827 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33390) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:12.269363 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'security_group_rule': {'security_group_id': '3d6313c3-d5a9-4821-91a9-8d9461d2e507', 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:12.275090 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:12.279550 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:12.282447 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:12.288203 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:12.303266 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df48b365-1633-44c5-aa3e-e00a60692633 req-0a2dd56e-9ab2-4b10-a2af-371ba3f41f60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:12.305147 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df48b365-1633-44c5-aa3e-e00a60692633 req-0a2dd56e-9ab2-4b10-a2af-371ba3f41f60 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 200  len: 854 time: 0.0769420
Jun 01 12:39:12.306411 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.347826 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.373160 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b90820>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '45919513-0043-4aab-a6c6-b8268504d048', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'floating_ip_address': '172.27.3.64', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'port_id': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'mac_address': 'fa:16:3e:56:f2:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:39:10Z', 'updated_at': '2021-06-01T12:39:10Z', 'revision_number': 0, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:12.377331 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] Checking router: 43f207c7-1198-400a-9361-6f9c7b4a3880 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:39:12.386078 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:39:12.387325 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b90820>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:38:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:12.387679 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.392177 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.394594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df48b365-1633-44c5-aa3e-e00a60692633 req-a37e4356-38b5-431f-b7ec-517e633fe5c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:12.394746 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:12.395476 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df48b365-1633-44c5-aa3e-e00a60692633 req-a37e4356-38b5-431f-b7ec-517e633fe5c7 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0808909
Jun 01 12:39:12.417766 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=081d3be1-6435-480c-bdb9-ce93ae383661,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:12.423068 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:12.431035 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.434039 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-8292980d-849c-4933-a005-e6347ade96a5 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.1672499
Jun 01 12:39:12.435844 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33394) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:12.441448 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'security_group_rule': {'security_group_id': '3d6313c3-d5a9-4821-91a9-8d9461d2e507', 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:12.447618 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:12.452008 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:12.455175 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:12.461479 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:12.478176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.535979 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df48b365-1633-44c5-aa3e-e00a60692633 req-f04082d6-2ca1-4807-a5e1-edc496c919a1 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1338308
Jun 01 12:39:12.544805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.549014 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.551034 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f7f49d3c-2693-4ef7-b7d4-a988a55afb4e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:12.575210 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=52239ab7-4d42-451d-827a-8f51dd711d5a,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:12.575485 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:39:12.578010 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:12.587331 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.591285 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1514924
Jun 01 12:39:12.591527 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33398) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:12.596880 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'security_group_rule': {'security_group_id': '3d6313c3-d5a9-4821-91a9-8d9461d2e507', 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:12.603116 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:12.607156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:12.611197 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:12.618054 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:12.638457 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.675433 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-df48b365-1633-44c5-aa3e-e00a60692633 req-bb6d6db2-459a-4503-8af6-217e8a247c74 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1325910
Jun 01 12:39:12.709903 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.714054 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.716328 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-49b39a84-59cb-4f5b-beda-bb3ac5a25123 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:12.738651 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=813cf48b-962a-4262-b559-7bb90c10e2ef,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:12.741153 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:12.749894 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-a6bba0d6-fb87-4657-8dab-2ea152d6bb0e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.750542 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.751678 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9c7b1582-bc20-4bc5-a007-eb2a361ba965 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1589582
Jun 01 12:39:12.754382 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33404) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:12.759818 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'security_group_rule': {'security_group_id': '3d6313c3-d5a9-4821-91a9-8d9461d2e507', 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:12.766141 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:12.769887 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:12.772711 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:12.778653 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:12.788636 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.securitygroups_db [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Project c9f26a8407554421b6fc3162658b8a00 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 12:39:12.794246 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.859938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.863974 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.866040 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:12.888570 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dba16971-754c-412f-a443-1cc770932f1f,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:12.891045 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:12.899401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.900672 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-c1cffb8e-e2d6-42fd-b701-a00c4cad665c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1451647
Jun 01 12:39:12.903362 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33408) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:12.908401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'security_group_rule': {'security_group_id': '3d6313c3-d5a9-4821-91a9-8d9461d2e507', 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:12.914414 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:12.918760 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Usage tracker for resource:security_group_rule and tenant:c9f26a8407554421b6fc3162658b8a00 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:12.921711 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:12.927747 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:12.942577 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.securitygroups_db [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Project c9f26a8407554421b6fc3162658b8a00 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
Jun 01 12:39:12.949384 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:12.961839 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b90820>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '45919513-0043-4aab-a6c6-b8268504d048', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'floating_ip_address': '172.27.3.64', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'port_id': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'mac_address': 'fa:16:3e:56:f2:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:39:10Z', 'updated_at': '2021-06-01T12:39:10Z', 'revision_number': 0, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:12.965931 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b7e9e70-ade9-4dae-bb40-5e8102ad517c None None] The sync data for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi is: [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '45919513-0043-4aab-a6c6-b8268504d048', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'floating_ip_address': '172.27.3.64', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'port_id': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'mac_address': 'fa:16:3e:56:f2:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:39:10Z', 'updated_at': '2021-06-01T12:39:10Z', 'revision_number': 0, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:39:13.018413 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.022332 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.028889 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:13.053174 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7e43fa08-f5c9-44b1-b911-7bc91a47cd5f,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:13.055816 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:13.064103 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.068720 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a3c86db9-4841-489a-9267-fe37006423e3 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1611803
Jun 01 12:39:13.178091 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec22dd35-f345-40bf-8b46-2c9126b0d921 None None] New status for floating IP 45919513-0043-4aab-a6c6-b8268504d048: ACTIVE {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:39:13.206829 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-03c70efc-6475-4d68-bc7d-a704a98c5f8c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1566501766&fields=id&tenant_id=c9f26a8407554421b6fc3162658b8a00 HTTP/1.1" status: 200  len: 267 time: 0.0445848
Jun 01 12:39:13.290107 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-395a3060-e9d0-4b58-b7cf-62d8d177d729 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:13.291545 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-395a3060-e9d0-4b58-b7cf-62d8d177d729 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0793331
Jun 01 12:39:13.302732 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'port': {'security_groups': ['b4540638-fbb0-447a-9b8e-046c38d5174a', '3d6313c3-d5a9-4821-91a9-8d9461d2e507']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:13.424540 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.765726 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:13.789379 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.794514 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.800231 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:13.806212 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d93addc7-07f1-4d9e-8775-05a3301e8f0e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:39:13.866992 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:13.867785 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.869260 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1f07dca-fb4f-4c23-8edb-d4b29f79de54 req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "PUT /v2.0/ports/d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 981 time: 0.5709054
Jun 01 12:39:13.869781 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:13.873088 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d426864-0f1e-4205-8280-adde70f841cc" -d '{"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:13.886785 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:13.899407 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=6']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:13.911313 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:13.930171 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-263050b4-f5e4-4a8b-9049-45626e370e17 x-openstack-request-id: req-263050b4-f5e4-4a8b-9049-45626e370e17 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:13.930496 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:13.931451 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-263050b4-f5e4-4a8b-9049-45626e370e17 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:13.931879 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'status': 'completed', 'code': 200}
Jun 01 12:39:13.971945 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d93addc7-07f1-4d9e-8775-05a3301e8f0e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:39:14.104589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d426864-0f1e-4205-8280-adde70f841cc req-85de09fb-2849-4dd2-9594-5ae5b580e193 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:14.106357 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d426864-0f1e-4205-8280-adde70f841cc req-85de09fb-2849-4dd2-9594-5ae5b580e193 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1137 time: 0.1503522
Jun 01 12:39:14.114655 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae165482-5d9d-4599-8546-b015f32ac975 req-dfc8961d-4d2a-4e06-b556-e7638ad34557 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:14.116189 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae165482-5d9d-4599-8546-b015f32ac975 req-dfc8961d-4d2a-4e06-b556-e7638ad34557 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.1207700
Jun 01 12:39:14.197392 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-c745f048-22c6-4fad-9531-4902c59583a0 None None] Provisioning complete for port d93addc7-07f1-4d9e-8775-05a3301e8f0e triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:39:14.197771 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c745f048-22c6-4fad-9531-4902c59583a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:14.242947 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae165482-5d9d-4599-8546-b015f32ac975 req-51e90835-6ec1-44c6-8c73-354663434a0e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1065564
Jun 01 12:39:14.285543 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d426864-0f1e-4205-8280-adde70f841cc req-715b28d5-3953-4d8b-b9f9-d660f075a33c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:14.286890 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d426864-0f1e-4205-8280-adde70f841cc req-715b28d5-3953-4d8b-b9f9-d660f075a33c service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 916 time: 0.1698334
Jun 01 12:39:14.391502 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d426864-0f1e-4205-8280-adde70f841cc req-ba1eb8f4-0233-4608-b37e-9b2fe982c1eb service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 1000 time: 0.0951841
Jun 01 12:39:14.459289 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d426864-0f1e-4205-8280-adde70f841cc req-0719da7a-184e-4f55-9368-aff9f26d8e66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:14.460776 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d426864-0f1e-4205-8280-adde70f841cc req-0719da7a-184e-4f55-9368-aff9f26d8e66 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 200  len: 854 time: 0.0630636
Jun 01 12:39:14.537455 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d426864-0f1e-4205-8280-adde70f841cc req-a2369abf-34c4-471e-bad0-1b963b2e2000 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:14.538824 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d426864-0f1e-4205-8280-adde70f841cc req-a2369abf-34c4-471e-bad0-1b963b2e2000 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0698233
Jun 01 12:39:14.672531 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d426864-0f1e-4205-8280-adde70f841cc req-d3a323fc-1723-4541-bd8c-7db5a714e9f9 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1256599
Jun 01 12:39:14.804084 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d426864-0f1e-4205-8280-adde70f841cc req-71ae19ab-cc5b-4982-9752-f4e673833cc8 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1240530
Jun 01 12:39:15.399834 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:21.878808 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c165c483-ea00-4ffc-8f2a-33c3ff473ebb req-eff6113a-0781-487b-a182-3ec0e09495ca tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:21.880255 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c165c483-ea00-4ffc-8f2a-33c3ff473ebb req-eff6113a-0781-487b-a182-3ec0e09495ca tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1338573
Jun 01 12:39:21.927831 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c165c483-ea00-4ffc-8f2a-33c3ff473ebb req-0ab60aa1-ebce-4b66-941b-03d25772a74e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0416174
Jun 01 12:39:22.201869 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54240c4-72ce-4ab9-845f-27af8252c725 req-e65757c1-73bd-44b6-8cca-69f199f3eac5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:22.203217 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a54240c4-72ce-4ab9-845f-27af8252c725 req-e65757c1-73bd-44b6-8cca-69f199f3eac5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.0795925
Jun 01 12:39:22.250536 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a54240c4-72ce-4ab9-845f-27af8252c725 req-c9cf3169-29f1-4f76-aaf6-18537f2e8f15 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0411751
Jun 01 12:39:23.128815 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d5cc86-3cdc-4e2e-aec8-de15202846c6 req-e44bdce4-f2b0-492d-807d-d91c6b0c5b26 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:23.130310 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d9d5cc86-3cdc-4e2e-aec8-de15202846c6 req-e44bdce4-f2b0-492d-807d-d91c6b0c5b26 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0821474
Jun 01 12:39:23.174996 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d9d5cc86-3cdc-4e2e-aec8-de15202846c6 req-1e413a63-07c0-4b66-a0d6-94107f3c6c93 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388627
Jun 01 12:39:23.445873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271be026-8dac-42c2-820c-2b80be56a2a2 req-c701f100-dc9a-4f17-bc3d-ca8ded30b16e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:23.447322 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-271be026-8dac-42c2-820c-2b80be56a2a2 req-c701f100-dc9a-4f17-bc3d-ca8ded30b16e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.0899436
Jun 01 12:39:23.491449 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-271be026-8dac-42c2-820c-2b80be56a2a2 req-8286c561-222c-45c9-bb82-86df9f055070 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379801
Jun 01 12:39:24.314047 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-12c36950-6735-4927-a7d4-e03a85edeb36 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:24.315433 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-12c36950-6735-4927-a7d4-e03a85edeb36 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.0790958
Jun 01 12:39:24.367109 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b71e9ba-9914-478b-a322-9ad366494286 req-a324be7d-a620-49aa-a4b7-ab8a4bba3693 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:24.368605 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0b71e9ba-9914-478b-a322-9ad366494286 req-a324be7d-a620-49aa-a4b7-ab8a4bba3693 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0841539
Jun 01 12:39:24.412911 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0b71e9ba-9914-478b-a322-9ad366494286 req-8cb96e91-62a4-4b08-9274-5af9d486c83b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377543
Jun 01 12:39:24.460036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Deleting port 173aae46-c6ad-4fa4-b7a3-a900710d3701 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:39:24.460036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:24.719910 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] For port 173aae46-c6ad-4fa4-b7a3-a900710d3701, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=173aae46-c6ad-4fa4-b7a3-a900710d3701,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:24.720194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:24.806722 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccc4e60-88cd-4550-a29a-2b05e09576c1 req-f942ab18-1085-4dbb-b932-a8036816aa9b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:24.808174 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7ccc4e60-88cd-4550-a29a-2b05e09576c1 req-f942ab18-1085-4dbb-b932-a8036816aa9b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 945 time: 0.2044456
Jun 01 12:39:24.880056 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:39:24.945009 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7ccc4e60-88cd-4550-a29a-2b05e09576c1 req-2e4d2c26-f185-43bf-b1eb-29e157978d5d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=5b099188-b099-49ba-b755-aea87c47873e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1256506
Jun 01 12:39:25.055394 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:25.055666 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:25.055981 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Floating IP 595e28eb-9603-4a2e-91e7-06615e85864e disassociated. External IP: 172.27.3.247, port: 173aae46-c6ad-4fa4-b7a3-a900710d3701.
Jun 01 12:39:25.056308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Calling delete_port for 173aae46-c6ad-4fa4-b7a3-a900710d3701 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:39:25.166093 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:25.172285 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-80e89488-cac4-4e7f-ade8-696949de1d80 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:25.219746 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event deleted for resources: {'Port': ['ID=173aae46-c6ad-4fa4-b7a3-a900710d3701,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:25.278419 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.278780 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.279134 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.279480 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.279820 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.280160 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.280497 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.280857 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.281227 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.281564 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.281895 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.282224 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:25.285491 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:25.414357 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:39:25.597574 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:39:25.608886 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] Sync routers for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:39:25.612668 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0cef208-b722-4fcd-a17b-17ba287dc3d2 req-5c99902a-890b-4128-998f-d3842a5b65a1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:25.614164 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f0cef208-b722-4fcd-a17b-17ba287dc3d2 req-5c99902a-890b-4128-998f-d3842a5b65a1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0869224
Jun 01 12:39:25.621520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:39:25.622230 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d81610>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:39:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:25.665575 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f0cef208-b722-4fcd-a17b-17ba287dc3d2 req-19d6c539-389f-4972-b142-ea038a6f91ea tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0455327
Jun 01 12:39:25.670713 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] No DVR routers for this DVR port 173aae46-c6ad-4fa4-b7a3-a900710d3701 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:39:25.673427 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:25.676219 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'name': 'network-vif-deleted', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:25.678802 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab13a999-f391-4db4-8bed-7687108a4f5c" -d '{"events": [{"server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "name": "network-vif-deleted", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:25.694834 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ea412b31-7be4-49a1-b76b-1a1f57314353 req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "DELETE /v2.0/ports/173aae46-c6ad-4fa4-b7a3-a900710d3701 HTTP/1.1" status: 204  len: 173 time: 1.3735631
Jun 01 12:39:25.732159 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3a467da-f282-4b1f-92d1-ea70de7c4605 x-openstack-request-id: req-e3a467da-f282-4b1f-92d1-ea70de7c4605 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:25.732589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "85b9557f-c7e4-4c16-9015-9d4cb4240a5a", "name": "network-vif-deleted", "tag": "173aae46-c6ad-4fa4-b7a3-a900710d3701", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:25.732871 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-e3a467da-f282-4b1f-92d1-ea70de7c4605 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:25.733303 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '85b9557f-c7e4-4c16-9015-9d4cb4240a5a', 'name': 'network-vif-deleted', 'tag': '173aae46-c6ad-4fa4-b7a3-a900710d3701', 'status': 'completed', 'code': 200}
Jun 01 12:39:25.873036 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:39:26.111392 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-70a146ec-e013-4a00-a593-717a635556a1 req-11f72880-948d-44ec-8f25-9f6510294ed3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=85b9557f-c7e4-4c16-9015-9d4cb4240a5a HTTP/1.1" status: 200  len: 210 time: 0.0449326
Jun 01 12:39:26.213509 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d81610>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:26.217852 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] Checking router: 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:39:26.226764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:39:26.227310 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d81610>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:39:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:26.413021 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:39:26.726824 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d81610>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:26.731663 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26e193af-f8b0-4fdf-b44d-8a0e17d4aa2e None None] The sync data for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi is: [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:39:26.870594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082709d8-cc1e-41f1-97fd-ec600894438c req-571d8b26-d734-40a4-97d2-31e27cce7bdc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:26.872219 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-082709d8-cc1e-41f1-97fd-ec600894438c req-571d8b26-d734-40a4-97d2-31e27cce7bdc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0840857
Jun 01 12:39:26.920773 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-082709d8-cc1e-41f1-97fd-ec600894438c req-961b506a-895c-4a0d-b474-df04c438f923 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423727
Jun 01 12:39:26.969936 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04eedad8-f555-4019-a309-91567d6b1f6f None None] New status for floating IP 595e28eb-9603-4a2e-91e7-06615e85864e: DOWN {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:39:27.248737 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33496) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:27.321118 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:27.352355 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:27.406396 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:27.410292 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-588dfc85-d25e-40f6-9b94-2fa11d6327fe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:27.429231 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b099188-b099-49ba-b755-aea87c47873e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:27.439042 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.439478 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.439856 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.440215 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.440594 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.440955 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.441311 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.441662 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.442013 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.442362 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.442735 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.443079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:39:27.447958 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:27.452454 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:27.453651 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "DELETE /v2.0/security-groups/5b099188-b099-49ba-b755-aea87c47873e HTTP/1.1" status: 204  len: 168 time: 0.2038853
Jun 01 12:39:27.456204 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33500) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:27.473222 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.api.v2.resource [None req-ee2af15f-718d-4589-9cb1-f3590c8baa55 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] show failed (client error): The resource could not be found.
Jun 01 12:39:27.474116 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ee2af15f-718d-4589-9cb1-f3590c8baa55 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups/5b099188-b099-49ba-b755-aea87c47873e HTTP/1.1" status: 404  len: 347 time: 0.0169730
Jun 01 12:39:27.477090 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33504) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:27.705491 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Deleting port 0420406a-40b0-41f4-af1f-2b05286fa870 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:39:27.705727 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:27.820669 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:27.820883 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:27.877155 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 173aae46-c6ad-4fa4-b7a3-a900710d3701 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:39:27.911756 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 173aae46-c6ad-4fa4-b7a3-a900710d3701 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:39:27.912109 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 173aae46-c6ad-4fa4-b7a3-a900710d3701 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:39:27.970455 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Calling delete_port for 0420406a-40b0-41f4-af1f-2b05286fa870 owned by network:floatingip {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:39:28.231233 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:28.234860 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-089384ca-297d-43ad-b4f9-7291d7b1e6fd tempest-DeleteServersTestJSON-1947844411 tempest-DeleteServersTestJSON-1947844411-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:28.310980 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event deleted for resources: {'Port': ['ID=0420406a-40b0-41f4-af1f-2b05286fa870,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:28.313686 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:28.363377 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321adfdf-af40-469a-b4a9-1355ea8a78e3 req-c8d68196-a064-4fbe-849e-79715247c159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:28.364846 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-321adfdf-af40-469a-b4a9-1355ea8a78e3 req-c8d68196-a064-4fbe-849e-79715247c159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.3026705
Jun 01 12:39:28.416238 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:28.432478 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-321adfdf-af40-469a-b4a9-1355ea8a78e3 req-1a060b33-c90d-45eb-9b3b-8b86951a278a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0567403
Jun 01 12:39:28.439559 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:28.440711 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "DELETE /v2.0/floatingips/595e28eb-9603-4a2e-91e7-06615e85864e HTTP/1.1" status: 204  len: 168 time: 0.9627137
Jun 01 12:39:29.232871 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33512) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:29.238649 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1166191637', 'description': 'tempest-description--2012770630'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:29.244592 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:29.249301 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:29.252189 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:29.259229 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:29.269411 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.289529 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:29.293663 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group_rule and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:29.296807 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:29.302931 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:29.376877 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.384548 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.386730 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b19f1040-a29e-4feb-80af-1664629042d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:29.431901 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'SecurityGroup': ['ID=557c0853-95ed-46a5-89a8-65d51ab258d6,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:29.435213 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.436433 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.2025006
Jun 01 12:39:29.438165 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:29.439277 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 33516) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:29.444673 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'security_group_rule': {'security_group_id': '557c0853-95ed-46a5-89a8-65d51ab258d6', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:29.450924 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:29.454733 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group_rule and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:29.457578 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:29.463401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:29.481797 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.541631 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.545828 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.547896 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:29.602842 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b17c60b7-dd3f-4e86-b2ef-53c6f412869f,revision_number=0']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:29.611770 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:29.629433 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.630603 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2b4b4b48-777e-41d3-9437-c8392d389d40 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1903994
Jun 01 12:39:29.633400 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33522) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:29.638661 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'security_group_rule': {'security_group_id': '557c0853-95ed-46a5-89a8-65d51ab258d6', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:29.644311 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:29.648141 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:security_group_rule and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:29.651187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:29.656236 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07e86fd8-b498-4a64-8754-7a5c434e0dac req-3f8e9e78-c671-4def-8dba-ff47f30eb9f8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:29.656850 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:29.657726 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-07e86fd8-b498-4a64-8754-7a5c434e0dac req-3f8e9e78-c671-4def-8dba-ff47f30eb9f8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1038473
Jun 01 12:39:29.673859 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.708156 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-07e86fd8-b498-4a64-8754-7a5c434e0dac req-b80c63c6-3853-4155-9740-06808cc73946 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445201
Jun 01 12:39:29.735448 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.738961 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.740916 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:29.761896 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9a4b769f-4509-4261-bb3c-ef7c8a153388,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:29.764148 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:29.771382 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.772685 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-b520cf99-bc57-4ebd-8a73-24e2b9506a4b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1381655
Jun 01 12:39:29.775904 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33526) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:29.781485 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:29.787519 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:29.791320 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Usage tracker for resource:floatingip and tenant:b09a17145ef0415faebc5bbdb71e3f3c is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:39:29.794802 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:39:29.800450 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:29.813927 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:29.946922 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.163970 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Allocated IP 172.27.3.25 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/e75d92f0-df54-47a3-bba7-155e01b6faa6) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:39:30.308286 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.336955 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.340933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-574bd283-103e-4bd8-ae7c-726ddecb62fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:30.405617 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:39:30.408389 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:39:30.411946 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:39:30.441741 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'Port': ['ID=e75d92f0-df54-47a3-bba7-155e01b6faa6,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:30.448186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:30.493875 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.556580 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.762594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.767187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.770826 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:30.934265 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'Port': ['ID=e75d92f0-df54-47a3-bba7-155e01b6faa6,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:30.937540 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:30.951446 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.979694 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:30.980948 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.2035792
Jun 01 12:39:30.988857 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc2a6c0a-9536-4875-a6c8-18faf9abc86d req-b3a9caa6-ff69-461f-97ac-9af44b2e516e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:30.990322 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bc2a6c0a-9536-4875-a6c8-18faf9abc86d req-b3a9caa6-ff69-461f-97ac-9af44b2e516e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1686175
Jun 01 12:39:31.053157 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bc2a6c0a-9536-4875-a6c8-18faf9abc86d req-dd3d635e-955c-42b5-abef-d420b2f40ee6 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0412776
Jun 01 12:39:31.204339 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-31faf621-e007-4655-a06d-67aa437f22c9 req-3136e250-2521-453e-9240-5cf48c600cb2 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:39:31.218796 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-31faf621-e007-4655-a06d-67aa437f22c9 req-3136e250-2521-453e-9240-5cf48c600cb2 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:39:31.219965 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-3136e250-2521-453e-9240-5cf48c600cb2 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--1166191637&fields=id&tenant_id=b09a17145ef0415faebc5bbdb71e3f3c HTTP/1.1" status: 200  len: 267 time: 0.0567703
Jun 01 12:39:31.376569 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-883f1341-f924-4262-8622-af46e51fc0fd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:31.377931 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-883f1341-f924-4262-8622-af46e51fc0fd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 810 time: 0.1513267
Jun 01 12:39:31.392466 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-6d347cab-821e-49a1-a416-efe1f2fb0487 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/quotas/b09a17145ef0415faebc5bbdb71e3f3c HTTP/1.1" status: 200  len: 375 time: 0.0091434
Jun 01 12:39:31.477417 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-31faf621-e007-4655-a06d-67aa437f22c9 req-e65f945b-947d-4af5-a343-fd8e12270640 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:39:31.492672 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-31faf621-e007-4655-a06d-67aa437f22c9 req-e65f945b-947d-4af5-a343-fd8e12270640 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:39:31.494085 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-e65f945b-947d-4af5-a343-fd8e12270640 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0965805
Jun 01 12:39:31.630700 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-dbc695b5-0907-4cdc-a5e2-45a51c0b173d service neutron] 10.222.0.81 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1251836
Jun 01 12:39:31.763361 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b4abb2bd-b33b-48ea-a262-7c09c8d66d42 service neutron] 10.222.0.81 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1262562
Jun 01 12:39:31.940419 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-def7cd41-141f-4dad-a8ab-890e44cc97ea req-8a7dfe86-f7c7-4895-88d5-5415e10343f5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:39:31.954038 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-def7cd41-141f-4dad-a8ab-890e44cc97ea req-8a7dfe86-f7c7-4895-88d5-5415e10343f5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:39:31.955666 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-def7cd41-141f-4dad-a8ab-890e44cc97ea req-8a7dfe86-f7c7-4895-88d5-5415e10343f5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 210 time: 0.0582676
Jun 01 12:39:32.257688 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2538de54-f3bf-4deb-b90c-b6ba0a132b63 req-cb447948-2d7c-4c7c-ba7e-8cf3f4208bb2 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:32.259306 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2538de54-f3bf-4deb-b90c-b6ba0a132b63 req-cb447948-2d7c-4c7c-ba7e-8cf3f4208bb2 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0932949
Jun 01 12:39:32.306465 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2538de54-f3bf-4deb-b90c-b6ba0a132b63 req-c205290c-92ea-4c27-b4e9-808fb2fac003 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410392
Jun 01 12:39:33.174368 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b255acb6-39ae-4ed6-b2c0-0233cbb3fbbf req-df1930e6-7a5b-4da1-b835-6e8dc28186e1 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 210 time: 0.0489717
Jun 01 12:39:33.340286 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-44a83c5b-0e6c-40c7-ac51-052369db213d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:33.341634 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-44a83c5b-0e6c-40c7-ac51-052369db213d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 810 time: 0.1503973
Jun 01 12:39:33.399637 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-91598792-cedf-47db-b781-1db10645908f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b09a17145ef0415faebc5bbdb71e3f3c HTTP/1.1" status: 200  len: 380 time: 0.0462959
Jun 01 12:39:33.409706 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'port': {'device_id': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'admin_state_up': True, 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'security_groups': ['557c0853-95ed-46a5-89a8-65d51ab258d6']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:33.506321 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c6d5d8-7307-4d46-8798-01b30f669777 req-0dc35f9f-88ba-4759-83f3-c4045d2d7e02 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:33.507827 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-43c6d5d8-7307-4d46-8798-01b30f669777 req-0dc35f9f-88ba-4759-83f3-c4045d2d7e02 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0816278
Jun 01 12:39:33.552411 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-43c6d5d8-7307-4d46-8798-01b30f669777 req-38bcab42-7928-4b70-86cf-709371d94a8d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383000
Jun 01 12:39:33.553883 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:39:33.564140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:39:33.575291 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Made reservation on behalf of b09a17145ef0415faebc5bbdb71e3f3c for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:39:33.579460 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:33.738766 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Allocated IP 172.20.0.11 (a43c69f6-c415-4ad5-8f5b-032eacaeb49e/98e949e5-17bf-4e08-a5ea-232517784814/77238847-8750-416f-81a1-a7943b9df7f6) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:39:33.934715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:33.940123 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:39:33.952099 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Transition to ACTIVE for port object 77238847-8750-416f-81a1-a7943b9df7f6 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:39:33.974947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:33.981182 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:34.076167 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:34.088963 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'port_id': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'mac_address': 'fa:16:3e:ed:6f:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 756, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:39:34.122238 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:39:34.125422 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:39:34.129352 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:39:34.163119 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:34.185986 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id dd8500c8-5962-4478-9c99-20281668d7c6 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:39:34.189202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event updated for resources: {'Port': ['ID=77238847-8750-416f-81a1-a7943b9df7f6,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:34.194632 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:34.206799 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:34.211935 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:34.214334 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:34.220500 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:34.221364 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:34.254014 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8477914
Jun 01 12:39:34.295622 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=6']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:34.301581 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:34.339942 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['dd8500c8-5962-4478-9c99-20281668d7c6'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:39:34.354067 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Request body: {'port': {'device_id': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:34.394678 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5da696d2-7fa1-4aa0-a3df-05a28fe88489 None None] Provisioning for port 77238847-8750-416f-81a1-a7943b9df7f6 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:39:34.411249 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5da696d2-7fa1-4aa0-a3df-05a28fe88489 None None] Provisioning complete for port 77238847-8750-416f-81a1-a7943b9df7f6 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:39:34.411621 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5da696d2-7fa1-4aa0-a3df-05a28fe88489 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:34.499166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:34.516541 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee68480f-53cb-493d-9128-debc77ca9f8d req-79194ed5-d71d-443c-a056-57fa196ae44a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:34.517268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ee68480f-53cb-493d-9128-debc77ca9f8d req-79194ed5-d71d-443c-a056-57fa196ae44a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Synchronizing usage tracker for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:39:34.551022 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-5da696d2-7fa1-4aa0-a3df-05a28fe88489 None None] Port 77238847-8750-416f-81a1-a7943b9df7f6 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:39:34.581739 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ee68480f-53cb-493d-9128-debc77ca9f8d req-79194ed5-d71d-443c-a056-57fa196ae44a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Unset dirty status for tenant:b09a17145ef0415faebc5bbdb71e3f3c on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:39:34.583417 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee68480f-53cb-493d-9128-debc77ca9f8d req-79194ed5-d71d-443c-a056-57fa196ae44a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 932 time: 0.2790534
Jun 01 12:39:34.692489 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee68480f-53cb-493d-9128-debc77ca9f8d req-8505e1f7-c684-41fe-93a2-2959f25b128a tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0998797
Jun 01 12:39:34.779498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0cbe7af-6223-4bb4-8287-0d42d4b07a58 req-275d2d24-9246-4fdf-9e79-f7d6919265ca tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:34.785077 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a0cbe7af-6223-4bb4-8287-0d42d4b07a58 req-275d2d24-9246-4fdf-9e79-f7d6919265ca tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 944 time: 0.1049755
Jun 01 12:39:34.835827 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a0cbe7af-6223-4bb4-8287-0d42d4b07a58 req-aa19aa58-13fc-4003-b24a-21f527035439 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0475512
Jun 01 12:39:34.931190 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 77238847-8750-416f-81a1-a7943b9df7f6 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:39:34.944583 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:34.962553 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Transition to ACTIVE for port object 77238847-8750-416f-81a1-a7943b9df7f6 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:39:34.967979 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:34.972227 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-96057f54-da6e-4703-8ba5-a8bf511bc0d6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:35.111275 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Pushing event updated for resources: {'Port': ['ID=77238847-8750-416f-81a1-a7943b9df7f6,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:35.115780 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:35.251036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Attempting to bind port 77238847-8750-416f-81a1-a7943b9df7f6 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:39:35.251612 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Attempting to bind port 77238847-8750-416f-81a1-a7943b9df7f6 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:39:35.251718 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Attempting to bind port 77238847-8750-416f-81a1-a7943b9df7f6 on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:39:35.257287 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Port 77238847-8750-416f-81a1-a7943b9df7f6 on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:39:35.257614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Attempting to bind port 77238847-8750-416f-81a1-a7943b9df7f6 on network a43c69f6-c415-4ad5-8f5b-032eacaeb49e {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:39:35.263242 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 39, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:39:35.263600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Checking segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:39:35.263971 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Bound using segment: {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:39:35.264399 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Bound port: 77238847-8750-416f-81a1-a7943b9df7f6, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ba820a7-3059-4021-81f0-532d307e1908', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 765, 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:39:35.264805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:35.376016 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] For port 77238847-8750-416f-81a1-a7943b9df7f6, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:39:35.380028 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] For port 77238847-8750-416f-81a1-a7943b9df7f6, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=77238847-8750-416f-81a1-a7943b9df7f6,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:39:35.386299 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:35.389985 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7eca4358-5991-4080-971a-bee9d346c3c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:35.457252 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:35.458258 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:35.459975 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] 10.222.0.95 "PUT /v2.0/ports/77238847-8750-416f-81a1-a7943b9df7f6 HTTP/1.1" status: 200  len: 1094 time: 1.1935637
Jun 01 12:39:35.463187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:35.492635 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6d4e721-c299-4d3e-8f70-e68fd92fd535" -d '{"events": [{"name": "network-changed", "server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "tag": "77238847-8750-416f-81a1-a7943b9df7f6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:35.551938 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Pushing event updated for resources: {'Port': ['ID=77238847-8750-416f-81a1-a7943b9df7f6,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:35.597877 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-275b36bc-5023-4d87-b410-cdc81c127d8f x-openstack-request-id: req-275b36bc-5023-4d87-b410-cdc81c127d8f {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:35.598194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "tag": "77238847-8750-416f-81a1-a7943b9df7f6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:35.598473 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-275b36bc-5023-4d87-b410-cdc81c127d8f {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:35.598880 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6', 'status': 'completed', 'code': 200}
Jun 01 12:39:35.604178 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:35.648642 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-3d209875-8de3-41b6-815c-7cc25656b1de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:35.650744 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-3d209875-8de3-41b6-815c-7cc25656b1de service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 1097 time: 0.1061060
Jun 01 12:39:35.725855 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-3df9b79a-c4a2-4bda-b207-2f2d9ee42281 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=77238847-8750-416f-81a1-a7943b9df7f6 HTTP/1.1" status: 200  len: 217 time: 0.0665119
Jun 01 12:39:35.825482 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-5058eb73-ffeb-4256-b4ba-6874794b59da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:35.827015 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-5058eb73-ffeb-4256-b4ba-6874794b59da service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0918057
Jun 01 12:39:35.961575 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:39:35.984716 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31faf621-e007-4655-a06d-67aa437f22c9 req-2495aea7-29da-4ddc-a9f4-a8d9b7f63e4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:35.986422 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-2495aea7-29da-4ddc-a9f4-a8d9b7f63e4c service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1360958
Jun 01 12:39:36.035508 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85bbbf6b-702c-4d36-846d-ec4a9cf4807f req-a368d9c3-cb54-49a7-a412-2331b6bbbe81 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:36.038255 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85bbbf6b-702c-4d36-846d-ec4a9cf4807f req-a368d9c3-cb54-49a7-a412-2331b6bbbe81 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 944 time: 0.1878095
Jun 01 12:39:36.061299 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port dd8500c8-5962-4478-9c99-20281668d7c6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:39:36.061939 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:36.156390 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85bbbf6b-702c-4d36-846d-ec4a9cf4807f req-d4a4b403-1860-4899-8f57-6135253e238c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1094613
Jun 01 12:39:36.262892 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:36.295674 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-65495051-ff36-4653-bebf-625f2e5e480a service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2980094
Jun 01 12:39:36.302123 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:36.304676 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48e8f365-7ded-40e6-9e1a-751adfe6126e" -d '{"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-plugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:36.313516 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad154bc1-aa8d-4ae3-b65c-6ead9a099e1d req-3cabaa60-8371-485a-aeed-d43ebc4f6127 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:36.315236 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ad154bc1-aa8d-4ae3-b65c-6ead9a099e1d req-3cabaa60-8371-485a-aeed-d43ebc4f6127 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 944 time: 0.2914724
Jun 01 12:39:36.317978 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:36.325568 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:36.328166 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-2e386669-8f1c-4e1e-b9cf-cbc911194bf5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:36.402452 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d04c6c2-39a9-4731-8727-6239691d354e x-openstack-request-id: req-1d04c6c2-39a9-4731-8727-6239691d354e {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:36.402807 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-plugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:36.403010 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-1d04c6c2-39a9-4731-8727-6239691d354e {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:36.404158 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'code': 200}
Jun 01 12:39:36.436121 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=7']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:36.440442 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:36.461875 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ad154bc1-aa8d-4ae3-b65c-6ead9a099e1d req-fc46e5de-0d84-44cb-8b67-e3facdfb5067 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1269703
Jun 01 12:39:36.498401 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-31faf621-e007-4655-a06d-67aa437f22c9 req-1d230a83-deae-4a8f-9c91-f806ec5f28ce service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1821246
Jun 01 12:39:36.715230 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-1cfc84a7-672d-49e9-8ddb-2f8e8181b651 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:36.716745 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-1cfc84a7-672d-49e9-8ddb-2f8e8181b651 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 1097 time: 0.1503122
Jun 01 12:39:36.875261 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-567e11a5-4777-4c23-92ed-efe8f57ab4b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:36.876782 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-567e11a5-4777-4c23-92ed-efe8f57ab4b8 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.1521595
Jun 01 12:39:36.953771 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-48517709-bfdb-4f7b-a135-30e867cb6dce service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=77238847-8750-416f-81a1-a7943b9df7f6 HTTP/1.1" status: 200  len: 217 time: 0.0674117
Jun 01 12:39:37.022819 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-fa264821-d0b8-4a64-ae81-a9083124c3c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:37.024467 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-fa264821-d0b8-4a64-ae81-a9083124c3c7 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0622709
Jun 01 12:39:37.164587 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-82f281bd-a49c-43df-9683-7156ae6fa841 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:37.166299 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-82f281bd-a49c-43df-9683-7156ae6fa841 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1336973
Jun 01 12:39:37.460731 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3fd061b-2712-4c1f-b30a-82c53a1688aa req-eeb24491-e9f4-43ca-8212-e6b84efb61ae tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:37.470845 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f3fd061b-2712-4c1f-b30a-82c53a1688aa req-eeb24491-e9f4-43ca-8212-e6b84efb61ae tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.1217899
Jun 01 12:39:37.471097 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-e14eb40b-473c-449c-af72-0f2f21d1bd75 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2949178
Jun 01 12:39:37.526042 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-f3fd061b-2712-4c1f-b30a-82c53a1688aa req-02e78b1c-fb0b-4ba7-b5ce-5db8c341a4ce tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Synchronizing usage tracker for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:39:37.549908 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-f3fd061b-2712-4c1f-b30a-82c53a1688aa req-02e78b1c-fb0b-4ba7-b5ce-5db8c341a4ce tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Unset dirty status for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:39:37.560265 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f3fd061b-2712-4c1f-b30a-82c53a1688aa req-02e78b1c-fb0b-4ba7-b5ce-5db8c341a4ce tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0878608
Jun 01 12:39:37.616790 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-be55aae2-ee82-40a4-82a4-3e4885d95d31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:37.618325 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-be55aae2-ee82-40a4-82a4-3e4885d95d31 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1137 time: 0.2917624
Jun 01 12:39:37.631272 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-800a39f8-7256-4844-bab2-88fb991c54a7 req-a2bdd0bd-1705-48cc-9d67-9f3fbb6d2637 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:37.634070 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-800a39f8-7256-4844-bab2-88fb991c54a7 req-a2bdd0bd-1705-48cc-9d67-9f3fbb6d2637 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 944 time: 0.2660391
Jun 01 12:39:37.798742 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e6c2b1-ffa3-45b5-b13d-6122989b0b65 req-b62310d9-a33d-406b-bc45-2bcbce95927b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:37.799548 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6d4e721-c299-4d3e-8f70-e68fd92fd535 req-0149ed9d-d6d1-4cd3-aba4-bd78a68d8723 service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3204153
Jun 01 12:39:37.800362 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-91e6c2b1-ffa3-45b5-b13d-6122989b0b65 req-b62310d9-a33d-406b-bc45-2bcbce95927b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1193359
Jun 01 12:39:37.840172 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-800a39f8-7256-4844-bab2-88fb991c54a7 req-39bff214-7a3a-4fd4-aa09-f8946e87669b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1642191
Jun 01 12:39:37.851590 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-91e6c2b1-ffa3-45b5-b13d-6122989b0b65 req-2388a66c-b1a8-48a2-b5ea-a3abe6b78605 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0450215
Jun 01 12:39:37.874237 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-f7fc4133-19c7-4c9b-8f01-ff543f2f7333 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:37.875894 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-f7fc4133-19c7-4c9b-8f01-ff543f2f7333 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 916 time: 0.2408438
Jun 01 12:39:38.013698 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-739ed84c-b5ed-41b0-8890-38845cf6037b service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 1000 time: 0.1306512
Jun 01 12:39:38.088349 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-e5060fb1-39f5-41c2-b38d-9c790b310d8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:38.090475 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-e5060fb1-39f5-41c2-b38d-9c790b310d8e service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 200  len: 854 time: 0.0687671
Jun 01 12:39:38.185567 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-488a420f-e1dd-44dd-a499-063ad8aac1d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:38.187302 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-488a420f-e1dd-44dd-a499-063ad8aac1d7 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0869656
Jun 01 12:39:38.471262 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-aad61b57-7449-402c-b2ee-7a244eef762f service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2740407
Jun 01 12:39:38.618405 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a3001aa8-c6bf-4381-9568-51d82346fa93 req-cc9cde3f-a71e-43e6-84b0-0d952e5d0e64 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1366410
Jun 01 12:39:38.763061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6afe1f1-a32c-4ab9-a13c-c639631e0d16 req-d446387f-9357-4564-a5be-4272d3ba855e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:38.765124 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6afe1f1-a32c-4ab9-a13c-c639631e0d16 req-d446387f-9357-4564-a5be-4272d3ba855e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.0881789
Jun 01 12:39:38.819632 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f6afe1f1-a32c-4ab9-a13c-c639631e0d16 req-ee8ed260-f94d-44a0-9a8c-830b73c60ebc tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0486615
Jun 01 12:39:39.104380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6fbb2ef-ae8f-400a-9bf8-ff5ee3aaced8 req-7bd154d9-ad1c-4e96-ae22-ed1f7461b7a0 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:39.106020 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d6fbb2ef-ae8f-400a-9bf8-ff5ee3aaced8 req-7bd154d9-ad1c-4e96-ae22-ed1f7461b7a0 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 944 time: 0.1033239
Jun 01 12:39:39.137294 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1405e996-1e2b-4e50-b0e7-10b6849d4cbc req-c9c52195-8bcf-4a5c-9c1a-fa3fb879d742 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:39.139008 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1405e996-1e2b-4e50-b0e7-10b6849d4cbc req-c9c52195-8bcf-4a5c-9c1a-fa3fb879d742 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1300101
Jun 01 12:39:39.189278 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d6fbb2ef-ae8f-400a-9bf8-ff5ee3aaced8 req-777a6af4-f656-4be4-8663-d5450717b49e tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0643859
Jun 01 12:39:39.201956 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1405e996-1e2b-4e50-b0e7-10b6849d4cbc req-d775dbf8-5731-4f28-b631-fedc0aeda04e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0555356
Jun 01 12:39:39.850866 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-c52a4530-b2cd-443b-b1b1-e4e3341b6d12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:39.968384 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 77238847-8750-416f-81a1-a7943b9df7f6 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:39:40.127904 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 77238847-8750-416f-81a1-a7943b9df7f6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=77238847-8750-416f-81a1-a7943b9df7f6,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:40.143314 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '77238847-8750-416f-81a1-a7943b9df7f6', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'port_id': '77238847-8750-416f-81a1-a7943b9df7f6', 'mac_address': 'fa:16:3e:80:d9:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 765, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:39:40.162483 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-747c58fa-2d32-4de9-aff3-1a95d06d0ff7 req-0e4c2e15-0acc-4c34-80b2-933979920e17 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:40.170562 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-747c58fa-2d32-4de9-aff3-1a95d06d0ff7 req-0e4c2e15-0acc-4c34-80b2-933979920e17 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.2171974
Jun 01 12:39:40.211127 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:40.228683 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 77238847-8750-416f-81a1-a7943b9df7f6 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:39:40.246619 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 77238847-8750-416f-81a1-a7943b9df7f6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=77238847-8750-416f-81a1-a7943b9df7f6,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:40.257267 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-747c58fa-2d32-4de9-aff3-1a95d06d0ff7 req-5fb3b491-e22c-478c-81aa-9a28edd62de4 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0832076
Jun 01 12:39:40.261176 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:40.268348 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e886e313-bfa7-4d8a-bf08-189de46e29e2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:40.423363 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=77238847-8750-416f-81a1-a7943b9df7f6,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:40.428676 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:40.496558 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c5ec0a4-c8c4-4695-9593-785e09efc133 req-839fc657-2d9d-462c-b4ce-0528188f6758 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:40.498431 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2c5ec0a4-c8c4-4695-9593-785e09efc133 req-839fc657-2d9d-462c-b4ce-0528188f6758 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1285813
Jun 01 12:39:40.519315 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad08f7f-eb63-4d09-b71d-53333169899d req-57fd9621-0f75-4353-900f-7527e4d83ccc tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:40.520840 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bad08f7f-eb63-4d09-b71d-53333169899d req-57fd9621-0f75-4353-900f-7527e4d83ccc tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 945 time: 0.1518869
Jun 01 12:39:40.531183 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-72d7ff66-a72d-4804-a9f0-3da210934201 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1284702
Jun 01 12:39:40.557888 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2c5ec0a4-c8c4-4695-9593-785e09efc133 req-89f6ba3f-47ef-461d-b95f-12fadc5003c6 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0523961
Jun 01 12:39:40.561721 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['77238847-8750-416f-81a1-a7943b9df7f6'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:39:40.623640 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bad08f7f-eb63-4d09-b71d-53333169899d req-fe759ec9-b1cb-4962-80dd-e45d3337ded3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0912194
Jun 01 12:39:40.672865 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-0193b2dc-747d-407a-b556-2f22add2b04a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:40.674603 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-0193b2dc-747d-407a-b556-2f22add2b04a service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 1099 time: 0.1128922
Jun 01 12:39:40.863607 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-332c2000-f597-43b4-9c1e-6baf766dc51a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:40.865094 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-332c2000-f597-43b4-9c1e-6baf766dc51a service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1663513
Jun 01 12:39:40.977727 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-3af7423e-c345-4608-b40f-9bc1a25404ff service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=30a14b45-81e5-4718-a910-a6b768fc753f HTTP/1.1" status: 200  len: 1002 time: 0.1052902
Jun 01 12:39:41.046305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-006014d8-4a81-40a7-9d04-62589938eabb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:41.048018 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-006014d8-4a81-40a7-9d04-62589938eabb service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0626540
Jun 01 12:39:41.127661 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-fb811cbb-161f-40e0-aad8-2e7d5e7e3f43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:41.129286 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-fb811cbb-161f-40e0-aad8-2e7d5e7e3f43 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0739682
Jun 01 12:39:41.293575 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-649ab57b-06e3-44a6-abfa-3bb9eb6fcbca service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1565297
Jun 01 12:39:41.441942 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-496944db-a95b-48f2-a9fb-d6caf78a4196 req-230db7fd-c1a6-4c89-8b7b-83885fd98def service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1395154
Jun 01 12:39:41.471350 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d9d0609-16e8-4055-a26d-67ff40009c8d req-d233a3fd-c1e0-405f-bfc5-8ed648a0ac37 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:41.472894 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9d9d0609-16e8-4055-a26d-67ff40009c8d req-d233a3fd-c1e0-405f-bfc5-8ed648a0ac37 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.0954156
Jun 01 12:39:41.524177 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9d9d0609-16e8-4055-a26d-67ff40009c8d req-84e975bf-dde5-41ef-9bf5-a129a73e3ed8 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0454185
Jun 01 12:39:41.788365 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da08a986-2673-403c-8db2-6f046999202d req-44087efd-dda0-4495-a484-65fc7655db8f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:41.795845 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da08a986-2673-403c-8db2-6f046999202d req-44087efd-dda0-4495-a484-65fc7655db8f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1071932
Jun 01 12:39:41.843576 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da08a986-2673-403c-8db2-6f046999202d req-8bd5d173-cf72-4e26-9481-eb3063cb454f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0468571
Jun 01 12:39:41.870759 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d18c95-3a70-4a38-a00f-24d2fff42fd4 req-44de558d-31d4-4c1e-856d-a4892de29a73 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:41.870759 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d2d18c95-3a70-4a38-a00f-24d2fff42fd4 req-44de558d-31d4-4c1e-856d-a4892de29a73 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 945 time: 0.1207752
Jun 01 12:39:41.923757 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d2d18c95-3a70-4a38-a00f-24d2fff42fd4 req-21008acd-a6f4-4678-96a3-0a3e29adfa0b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0505972
Jun 01 12:39:41.989899 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 77238847-8750-416f-81a1-a7943b9df7f6 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:39:42.081593 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 77238847-8750-416f-81a1-a7943b9df7f6 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:39:42.086468 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 77238847-8750-416f-81a1-a7943b9df7f6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:39:42.086827 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:42.119489 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:42.230266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:42.259907 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:42.262284 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a827baf6-0639-4188-b041-6ca7424311ee" -d '{"events": [{"server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "name": "network-vif-plugged", "status": "completed", "tag": "77238847-8750-416f-81a1-a7943b9df7f6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:42.270885 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 77238847-8750-416f-81a1-a7943b9df7f6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=77238847-8750-416f-81a1-a7943b9df7f6,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:42.278416 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:42.280011 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:42.311786 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f74a50a-3e71-4eb9-a004-48dd2060a36f x-openstack-request-id: req-6f74a50a-3e71-4eb9-a004-48dd2060a36f {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:42.312095 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "name": "network-vif-plugged", "status": "completed", "tag": "77238847-8750-416f-81a1-a7943b9df7f6", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:42.315041 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-6f74a50a-3e71-4eb9-a004-48dd2060a36f {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:42.316106 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6', 'code': 200}
Jun 01 12:39:42.391386 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=77238847-8750-416f-81a1-a7943b9df7f6,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:42.395544 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:42.403306 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:42.575326 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6d47102-5255-4de7-9691-2f746621a7a1 req-da39a2f0-8453-4dd1-a5db-f0928ef687a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:42.576968 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c6d47102-5255-4de7-9691-2f746621a7a1 req-da39a2f0-8453-4dd1-a5db-f0928ef687a1 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 1099 time: 0.0780175
Jun 01 12:39:42.626177 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c6d47102-5255-4de7-9691-2f746621a7a1 req-911f8e57-09cf-4f9c-b8d0-8dae07c942db service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401816
Jun 01 12:39:42.677479 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-a5ebf02b-1f6f-4bc9-9554-01208f4a3e46 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:42.731081 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dcf885d-ab8e-4643-ad00-178a410e165c req-fde25e2d-1992-45c2-af27-5f87a04a81be tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:42.732594 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6dcf885d-ab8e-4643-ad00-178a410e165c req-fde25e2d-1992-45c2-af27-5f87a04a81be tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.0950971
Jun 01 12:39:42.781937 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6dcf885d-ab8e-4643-ad00-178a410e165c req-16b2a292-2aff-4961-b039-23f80b19e16d tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0432360
Jun 01 12:39:43.060824 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-061a1e94-e96a-40fd-bbfd-49a03b045131 req-196a3c61-a036-4438-a9ba-d584979310ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:43.062444 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-061a1e94-e96a-40fd-bbfd-49a03b045131 req-196a3c61-a036-4438-a9ba-d584979310ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0913377
Jun 01 12:39:43.146224 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-061a1e94-e96a-40fd-bbfd-49a03b045131 req-fe7b2ded-6cce-402d-8f31-5ba32420b0e0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0769820
Jun 01 12:39:43.151582 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d56452-bca9-41ad-a42d-9b246d5046a1 req-a6507282-04d0-4f24-b2a2-bc02a6b1813b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:43.153266 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-67d56452-bca9-41ad-a42d-9b246d5046a1 req-a6507282-04d0-4f24-b2a2-bc02a6b1813b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 946 time: 0.1042888
Jun 01 12:39:43.216573 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-67d56452-bca9-41ad-a42d-9b246d5046a1 req-eef87818-8365-4157-a660-29aa8b143368 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0567775
Jun 01 12:39:43.862145 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:44.110655 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c255bd-bb09-4ed1-afde-66d6d84f41d1 req-451dd3ad-d564-4193-8420-211f50ad1a9c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:44.118681 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-14c255bd-bb09-4ed1-afde-66d6d84f41d1 req-451dd3ad-d564-4193-8420-211f50ad1a9c tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.2147365
Jun 01 12:39:44.176111 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-14c255bd-bb09-4ed1-afde-66d6d84f41d1 req-8baa9bee-cd53-4d48-a2a8-f4f41c003911 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0563462
Jun 01 12:39:44.382267 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef92a55-90f1-412e-a5e6-ce4a62515270 req-d6c6eb84-e4b0-4c91-9e0c-f247f0bc784c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:44.389843 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4ef92a55-90f1-412e-a5e6-ce4a62515270 req-d6c6eb84-e4b0-4c91-9e0c-f247f0bc784c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.1092522
Jun 01 12:39:44.434527 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbd40eb4-5b46-4f49-91bb-acc480f1b181 req-f8201893-291e-4e7d-8747-8aaa349a3cb3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:44.436080 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bbd40eb4-5b46-4f49-91bb-acc480f1b181 req-f8201893-291e-4e7d-8747-8aaa349a3cb3 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 946 time: 0.1045377
Jun 01 12:39:44.452480 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4ef92a55-90f1-412e-a5e6-ce4a62515270 req-ccb24b05-abd7-42df-8ab8-f8b641e0fc7f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0579834
Jun 01 12:39:44.497620 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bbd40eb4-5b46-4f49-91bb-acc480f1b181 req-0b56f505-86ae-4c67-bcab-0a86be32ff3f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0499823
Jun 01 12:39:44.681101 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5063b835-b8d5-4af2-831a-96d97112fb11 req-1e81c045-7f6a-4f02-831e-e6eb5352a4ed tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:44.683077 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5063b835-b8d5-4af2-831a-96d97112fb11 req-1e81c045-7f6a-4f02-831e-e6eb5352a4ed tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 946 time: 0.0809641
Jun 01 12:39:44.691836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33678) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:44.699730 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Request body: {'floatingip': {'port_id': '77238847-8750-416f-81a1-a7943b9df7f6'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:39:44.774964 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:45.339969 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-4dd54f56-22c7-4c6e-8fec-e554208a11e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:45.341417 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-4dd54f56-22c7-4c6e-8fec-e554208a11e0 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1098 time: 0.1598835
Jun 01 12:39:45.405062 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:45.451398 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.db.resource_extend [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
Jun 01 12:39:45.569288 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:45.578081 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aaf53ac-e01f-46a7-8f7c-b6970920311f req-ee38707b-c4b9-4337-9976-98d7405c9b69 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:45.579510 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5aaf53ac-e01f-46a7-8f7c-b6970920311f req-ee38707b-c4b9-4337-9976-98d7405c9b69 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.3009381
Jun 01 12:39:45.590227 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:45.634973 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a847713-7645-4c92-a454-9fa663dfc57f req-8e5d0f11-b244-4b20-99a7-49187f909d4a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:45.637125 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4a847713-7645-4c92-a454-9fa663dfc57f req-8e5d0f11-b244-4b20-99a7-49187f909d4a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0833242
Jun 01 12:39:45.685689 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4a847713-7645-4c92-a454-9fa663dfc57f req-8b6fea72-d9ab-4ad1-b53b-12680a4bf89f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427494
Jun 01 12:39:45.691219 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-08393241-cd32-4edc-ad0d-ecfc8d2cb134 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:45.692662 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-08393241-cd32-4edc-ad0d-ecfc8d2cb134 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.3429906
Jun 01 12:39:45.954638 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5aaf53ac-e01f-46a7-8f7c-b6970920311f req-5457d2d9-28bf-476d-924a-75878fa903bb tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.3652196
Jun 01 12:39:45.980144 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-9b395f89-ea42-4b26-99e9-77f2877cf684 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 200  len: 1001 time: 0.2728131
Jun 01 12:39:45.984360 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Floating IP 0afcb26d-7fa1-4eb4-8fdc-c769751b6daf associated. External IP: 172.27.3.25, port: 77238847-8750-416f-81a1-a7943b9df7f6.
Jun 01 12:39:46.183125 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-f20beefd-00f9-459a-ab53-71a62cd8205d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:46.184548 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-f20beefd-00f9-459a-ab53-71a62cd8205d service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.1542625
Jun 01 12:39:46.415837 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-ca46bf37-db35-4c03-bc48-73e05562f270 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:46.417859 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-ca46bf37-db35-4c03-bc48-73e05562f270 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2243657
Jun 01 12:39:46.498501 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:39:46.678304 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-169a083a-b7f2-41e4-89b5-6d63d14bf50b service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2522671
Jun 01 12:39:46.794053 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:39:46.799530 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:46.803741 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] Sync routers for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:39:46.814639 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:39:46.815256 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a250f4820>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:39:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:46.882977 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-916a0329-d415-46de-bfc6-65e16c4613c5 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "PUT /v2.0/floatingips/0afcb26d-7fa1-4eb4-8fdc-c769751b6daf HTTP/1.1" status: 200  len: 991 time: 2.1900597
Jun 01 12:39:46.884919 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:46.887303 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ae4f8df4-7832-431d-8378-6c9050a57719" -d '{"events": [{"name": "network-changed", "server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "tag": "77238847-8750-416f-81a1-a7943b9df7f6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:46.891769 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4d93db6b-8b67-46a7-b4d4-503a43b32aee req-0223d941-5e29-417e-8c84-b4af54b1a705 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2053163
Jun 01 12:39:46.900272 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b587bff-7961-41b4-ae64-b7d269572b30 req-7902f050-0469-4791-927d-ceab394296c6 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:46.902135 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6b587bff-7961-41b4-ae64-b7d269572b30 req-7902f050-0469-4791-927d-ceab394296c6 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0936580
Jun 01 12:39:46.954425 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6b587bff-7961-41b4-ae64-b7d269572b30 req-42b7fae0-c5ee-49d2-98ee-79bc963e2e03 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0450919
Jun 01 12:39:47.009797 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:39:47.022810 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37e69a02-6a9d-4353-b65e-3d2b5ac82e18 x-openstack-request-id: req-37e69a02-6a9d-4353-b65e-3d2b5ac82e18 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:47.023164 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "tag": "77238847-8750-416f-81a1-a7943b9df7f6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:47.023419 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-37e69a02-6a9d-4353-b65e-3d2b5ac82e18 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:47.023847 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6', 'status': 'completed', 'code': 200}
Jun 01 12:39:47.142279 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-90a7b700-343a-4cf4-bacf-4f2f804d35d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:47.143376 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-90a7b700-343a-4cf4-bacf-4f2f804d35d7 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 1099 time: 0.0947361
Jun 01 12:39:47.201685 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce7e4e0-4413-4f7d-9424-0673973b2b42 req-759bbad7-bdeb-4f58-866d-015e5d84d60e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:47.203176 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0ce7e4e0-4413-4f7d-9424-0673973b2b42 req-759bbad7-bdeb-4f58-866d-015e5d84d60e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.0876493
Jun 01 12:39:47.253775 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0ce7e4e0-4413-4f7d-9424-0673973b2b42 req-24783cbe-8f18-442a-b977-f7ebec525c4f tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0431268
Jun 01 12:39:47.277972 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-911f3ff9-694c-476e-8ca9-874636d88d0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:47.279401 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-911f3ff9-694c-476e-8ca9-874636d88d0c service neutron] 10.222.0.95 "GET /v2.0/networks?id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 200  len: 911 time: 0.1296401
Jun 01 12:39:47.410434 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a250f4820>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '0afcb26d-7fa1-4eb4-8fdc-c769751b6daf', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'floating_ip_address': '172.27.3.25', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'port_id': '77238847-8750-416f-81a1-a7943b9df7f6', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'mac_address': 'fa:16:3e:80:d9:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:39:30Z', 'updated_at': '2021-06-01T12:39:45Z', 'revision_number': 1, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:47.415459 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] Checking router: 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:39:47.425209 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:39:47.425833 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a250f4820>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:39:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:47.492061 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-9c15655d-3a7f-4b1a-a828-7cdd18685df5 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=77238847-8750-416f-81a1-a7943b9df7f6 HTTP/1.1" status: 200  len: 999 time: 0.2058268
Jun 01 12:39:47.556012 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-d52f2348-8cf1-465c-bb9c-d8e116cc3682 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:47.557943 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-d52f2348-8cf1-465c-bb9c-d8e116cc3682 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 200  len: 849 time: 0.0597506
Jun 01 12:39:47.602768 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:39:47.634979 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-87437509-c79c-45fd-8dc1-d27aeab0420a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:47.636459 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-87437509-c79c-45fd-8dc1-d27aeab0420a service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a43c69f6-c415-4ad5-8f5b-032eacaeb49e&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0700889
Jun 01 12:39:47.767083 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-aab0ffad-8b05-4df5-bbe6-0a4b0dcc3dbf service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1237199
Jun 01 12:39:47.898021 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ae4f8df4-7832-431d-8378-6c9050a57719 req-3995c5a6-7269-4aff-9a3d-52d502c3604b service neutron] 10.222.0.95 "GET /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1240153
Jun 01 12:39:47.952052 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a250f4820>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '0afcb26d-7fa1-4eb4-8fdc-c769751b6daf', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'floating_ip_address': '172.27.3.25', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'port_id': '77238847-8750-416f-81a1-a7943b9df7f6', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'mac_address': 'fa:16:3e:80:d9:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:39:30Z', 'updated_at': '2021-06-01T12:39:45Z', 'revision_number': 1, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:39:47.956147 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92e7c31d-c7ed-4919-a0b5-6b5c47b6b56d None None] The sync data for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi is: [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '0afcb26d-7fa1-4eb4-8fdc-c769751b6daf', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'floating_ip_address': '172.27.3.25', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'port_id': '77238847-8750-416f-81a1-a7943b9df7f6', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'mac_address': 'fa:16:3e:80:d9:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:39:30Z', 'updated_at': '2021-06-01T12:39:45Z', 'revision_number': 1, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:39:48.017475 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:39:48.151988 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:48.167844 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af56223-50b0-4f0a-bf61-51af9f246c81 req-cd1abf5f-e6c6-46d6-976e-a9679a2e571a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:48.169712 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6af56223-50b0-4f0a-bf61-51af9f246c81 req-cd1abf5f-e6c6-46d6-976e-a9679a2e571a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 945 time: 0.0908256
Jun 01 12:39:48.182968 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:39:48.185244 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c521700-dae1-4a25-9bd7-0dc607e2d9a9" -d '{"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:39:48.195426 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:39:48.202394 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:39:48.203643 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3181495e-0ae1-44b1-9b96-cf0d2a864560 None None] New status for floating IP 0afcb26d-7fa1-4eb4-8fdc-c769751b6daf: ACTIVE {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:39:48.205396 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:39:48.238047 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6af56223-50b0-4f0a-bf61-51af9f246c81 req-eb8922bc-c361-435a-b6fc-09c442213379 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0623922
Jun 01 12:39:48.245683 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 01 Jun 2021 12:39:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e93dc9f-afa9-474c-b620-b34cd87f0e74 x-openstack-request-id: req-3e93dc9f-afa9-474c-b620-b34cd87f0e74 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:39:48.245683 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:39:48.245957 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-3e93dc9f-afa9-474c-b620-b34cd87f0e74 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:39:48.246328 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'code': 200}
Jun 01 12:39:48.279185 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=8']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:39:48.282456 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:39:48.454604 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed7dd0ca-6fa0-472d-99bd-c3b8b0819a3e req-a6421a3b-bbdb-4572-8936-93b0b044bee1 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:48.456096 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ed7dd0ca-6fa0-472d-99bd-c3b8b0819a3e req-a6421a3b-bbdb-4572-8936-93b0b044bee1 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.0841770
Jun 01 12:39:48.514823 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ed7dd0ca-6fa0-472d-99bd-c3b8b0819a3e req-8ff47299-0f13-43ed-a19e-dc282481a547 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0478296
Jun 01 12:39:49.432453 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65c41969-c75f-46dc-ab21-a8d8b72c8f62 req-29b2f77a-b326-4aa4-b9a7-f3a093392b0c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:49.433876 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-65c41969-c75f-46dc-ab21-a8d8b72c8f62 req-29b2f77a-b326-4aa4-b9a7-f3a093392b0c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0827456
Jun 01 12:39:49.481572 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-65c41969-c75f-46dc-ab21-a8d8b72c8f62 req-38efe573-9a4d-4777-bbbb-31558fdb13ff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397172
Jun 01 12:39:49.706919 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7527c99-ee12-4e94-b9ef-9983e5833ce2 req-b55d2292-87aa-4cc0-aa4f-dcb5d053ce76 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:49.708445 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e7527c99-ee12-4e94-b9ef-9983e5833ce2 req-b55d2292-87aa-4cc0-aa4f-dcb5d053ce76 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.0818598
Jun 01 12:39:49.757150 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e7527c99-ee12-4e94-b9ef-9983e5833ce2 req-f512f7e4-896e-46b5-a9ae-250e63fa4c61 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&id=3d6313c3-d5a9-4821-91a9-8d9461d2e507&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0429492
Jun 01 12:39:50.401210 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58cbf0b-ccae-4a8b-bf10-4f9bd2869829 req-3cefa4c1-2f75-42b3-b76b-d9c60e71ab00 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:50.402715 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f58cbf0b-ccae-4a8b-bf10-4f9bd2869829 req-3cefa4c1-2f75-42b3-b76b-d9c60e71ab00 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0831664
Jun 01 12:39:50.448131 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f58cbf0b-ccae-4a8b-bf10-4f9bd2869829 req-1d78673c-0352-42ea-bd55-ea935688f8f7 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391381
Jun 01 12:39:50.533445 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 33746) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:39:50.647343 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-ff9b31e8-e9af-43c4-b1e3-32704b43827b service neutron] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1127117
Jun 01 12:39:51.654700 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d72c3c-25c4-4f5f-9a2d-52be843951f9 req-78701ebe-4d69-404e-8f86-32486108aa48 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:51.656018 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-22d72c3c-25c4-4f5f-9a2d-52be843951f9 req-78701ebe-4d69-404e-8f86-32486108aa48 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0936489
Jun 01 12:39:51.703353 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-22d72c3c-25c4-4f5f-9a2d-52be843951f9 req-8f55ea78-a34f-4d38-83ea-e0521a0d22ce tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415740
Jun 01 12:39:52.017415 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:39:52.333202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-bd48087f-d246-4b1f-9805-8ccd8dcda1ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:52.334552 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-bd48087f-d246-4b1f-9805-8ccd8dcda1ed service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c&tenant_id=dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 1096 time: 0.0741000
Jun 01 12:39:52.423569 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-03ec9d03-8ea8-4180-877b-3ad447d9abbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:52.425072 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-03ec9d03-8ea8-4180-877b-3ad447d9abbc service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1096 time: 0.0698159
Jun 01 12:39:52.555471 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-b0a94364-a02b-49de-8e53-59be911e2e7e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:52.556930 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-b0a94364-a02b-49de-8e53-59be911e2e7e service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.1264205
Jun 01 12:39:52.658183 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-07479bc0-02e3-4e1c-9f95-ff0ec3382f83 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 200  len: 999 time: 0.0950224
Jun 01 12:39:52.720828 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-ac172df1-1a75-4da9-8a17-26e0de650968 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:52.722372 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-ac172df1-1a75-4da9-8a17-26e0de650968 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0581040
Jun 01 12:39:52.798935 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-6b409a06-ec4b-48c8-b9c1-c7b63d9a02a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:52.800419 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-6b409a06-ec4b-48c8-b9c1-c7b63d9a02a6 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0721996
Jun 01 12:39:52.984184 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-f65efff1-00c8-478b-a9a3-db257f6fa09b service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1774330
Jun 01 12:39:52.995593 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eda1380-9d65-4afa-b9aa-52788767e8ec req-db5c3104-5e56-4f01-93db-9a2fb2fb8460 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:52.996952 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8eda1380-9d65-4afa-b9aa-52788767e8ec req-db5c3104-5e56-4f01-93db-9a2fb2fb8460 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.1725290
Jun 01 12:39:53.204492 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8eda1380-9d65-4afa-b9aa-52788767e8ec req-cb13fbb7-e49b-4026-a31b-7735327b08b9 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1894660
Jun 01 12:39:53.246795 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9e19c2-b619-4ff8-82bb-4f633e5a482e req-b5b1bd9c-3d1d-462b-bfb0-95469a18bf14 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2488120
Jun 01 12:39:53.430759 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9eba7d-c367-4409-a986-af04f0ae7313 req-733a767b-5401-44d2-95c4-4380079c3f56 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:53.432777 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9eba7d-c367-4409-a986-af04f0ae7313 req-733a767b-5401-44d2-95c4-4380079c3f56 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0779819
Jun 01 12:39:53.480144 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fc9eba7d-c367-4409-a986-af04f0ae7313 req-928bc83f-3490-42a7-864f-0caf4f0288ea tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415504
Jun 01 12:39:54.416119 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41988536-8160-456b-a1fd-db298f727611 req-530ebbb4-aa39-45d2-8c2a-9525f3961468 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:54.418366 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-41988536-8160-456b-a1fd-db298f727611 req-530ebbb4-aa39-45d2-8c2a-9525f3961468 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0934420
Jun 01 12:39:54.467067 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-41988536-8160-456b-a1fd-db298f727611 req-fcfb33ad-d53e-4df5-8775-800254d1de22 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0427477
Jun 01 12:39:54.673194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7274ac-63c4-49d4-9307-d3eb5c9ad291 req-d15901da-a5eb-449b-9f23-5f5a9a949dc4 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:54.674715 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8f7274ac-63c4-49d4-9307-d3eb5c9ad291 req-d15901da-a5eb-449b-9f23-5f5a9a949dc4 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0876188
Jun 01 12:39:54.720974 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8f7274ac-63c4-49d4-9307-d3eb5c9ad291 req-deced2d1-0a7a-4bea-8eda-2176d7ffb085 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401275
Jun 01 12:39:55.669138 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3552936-75e4-44b6-b971-a3b311e2353f req-e5ba4ff0-410a-4f15-ae96-6394d9ae7bf0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:55.670766 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3552936-75e4-44b6-b971-a3b311e2353f req-e5ba4ff0-410a-4f15-ae96-6394d9ae7bf0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0892265
Jun 01 12:39:55.718000 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e3552936-75e4-44b6-b971-a3b311e2353f req-19ae63e3-1428-4f79-b6b7-e5ac45217971 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0409312
Jun 01 12:39:55.917976 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3816a60d-845e-45aa-b886-63f7c9f247f0 req-495c03e0-5cf9-4062-bd34-e242b8ce7e7b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:55.919509 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3816a60d-845e-45aa-b886-63f7c9f247f0 req-495c03e0-5cf9-4062-bd34-e242b8ce7e7b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0872841
Jun 01 12:39:55.979483 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3816a60d-845e-45aa-b886-63f7c9f247f0 req-029bd4b9-1804-4b0c-83a8-b70d2aeb454d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0532787
Jun 01 12:39:57.068542 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32fe2ba0-347d-4884-9aec-859972925d43 req-2b0777d5-483a-4ece-89a0-914e896e9497 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:57.070495 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-32fe2ba0-347d-4884-9aec-859972925d43 req-2b0777d5-483a-4ece-89a0-914e896e9497 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0955017
Jun 01 12:39:57.117288 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-32fe2ba0-347d-4884-9aec-859972925d43 req-8003c8fc-556b-4e4d-862a-3aaf5c8d36f7 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398872
Jun 01 12:39:57.304381 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c29fb25-fba4-4b5c-b37b-d085e3a9579d req-b481c042-9c32-476d-9d47-b8e3dbfbd269 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:57.305911 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4c29fb25-fba4-4b5c-b37b-d085e3a9579d req-b481c042-9c32-476d-9d47-b8e3dbfbd269 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0847898
Jun 01 12:39:57.352335 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4c29fb25-fba4-4b5c-b37b-d085e3a9579d req-43532dc4-d648-47f5-b9ba-88ddacfffa5d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404916
Jun 01 12:39:58.321965 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c830da5b-92e2-4a44-bb32-d5e59b4063fa req-2440e4ae-da94-4c1b-b501-f79e978e2c05 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:58.324383 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c830da5b-92e2-4a44-bb32-d5e59b4063fa req-2440e4ae-da94-4c1b-b501-f79e978e2c05 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0885775
Jun 01 12:39:58.369994 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c830da5b-92e2-4a44-bb32-d5e59b4063fa req-8a7fcb3e-a7db-449c-8343-3eaa6e9eb9b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404789
Jun 01 12:39:58.554269 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f952fb81-8c57-4fe6-b947-50c731cbdd88 req-1dd14429-a0dd-4d94-8e0c-1ab1c5836ad8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:58.555721 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f952fb81-8c57-4fe6-b947-50c731cbdd88 req-1dd14429-a0dd-4d94-8e0c-1ab1c5836ad8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0862138
Jun 01 12:39:58.602179 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f952fb81-8c57-4fe6-b947-50c731cbdd88 req-1ba22e52-b83c-4191-8e39-1aed26d7fe96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0406497
Jun 01 12:39:59.566872 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f319a74c-c3df-40bc-8370-34ea5e4be85d req-b88650bf-dbe8-492e-b681-b46e23af0ddb tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:59.568651 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f319a74c-c3df-40bc-8370-34ea5e4be85d req-b88650bf-dbe8-492e-b681-b46e23af0ddb tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0820062
Jun 01 12:39:59.614519 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f319a74c-c3df-40bc-8370-34ea5e4be85d req-cc7b82fc-9e5e-463d-b965-e80798c99c28 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402660
Jun 01 12:39:59.807117 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f8ddc27-b7f1-4d14-be8a-99969abfad12 req-ff13215c-205f-46ff-be9e-9be0762af071 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:39:59.808646 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8f8ddc27-b7f1-4d14-be8a-99969abfad12 req-ff13215c-205f-46ff-be9e-9be0762af071 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0922832
Jun 01 12:39:59.858299 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8f8ddc27-b7f1-4d14-be8a-99969abfad12 req-49c9ad66-e4cf-4e28-8b94-e021d0cb1be6 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436108
Jun 01 12:40:00.812431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60c5e27-6e12-4959-bf73-4c5cfd5c294e req-83cb6b07-3622-40c0-a739-c81243b6d598 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:00.813926 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60c5e27-6e12-4959-bf73-4c5cfd5c294e req-83cb6b07-3622-40c0-a739-c81243b6d598 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0819588
Jun 01 12:40:00.865287 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60c5e27-6e12-4959-bf73-4c5cfd5c294e req-d038018f-2ff4-49d5-b582-be36da4bee46 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0446625
Jun 01 12:40:01.072799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd928a16-17a7-4804-87fe-d7e8ad39003e req-d0092324-3d62-46ab-8248-3ef5099a882e tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:01.074343 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cd928a16-17a7-4804-87fe-d7e8ad39003e req-d0092324-3d62-46ab-8248-3ef5099a882e tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.1001656
Jun 01 12:40:01.121973 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cd928a16-17a7-4804-87fe-d7e8ad39003e req-68b98549-0b4f-41c0-b80e-7674c78f992b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0414567
Jun 01 12:40:01.878615 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:40:02.071305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f436ad-7273-4759-8413-f0ec406b509f req-ca925396-9686-40aa-b7fb-1e1947a99bfc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:02.073350 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0f436ad-7273-4759-8413-f0ec406b509f req-ca925396-9686-40aa-b7fb-1e1947a99bfc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0870399
Jun 01 12:40:02.119839 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0f436ad-7273-4759-8413-f0ec406b509f req-0c9b79bb-2772-4d50-be3e-92bdf0916e45 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385215
Jun 01 12:40:02.312464 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba64d65-aaa4-4595-b52c-9c1e54500f33 req-6d3f831d-5020-4349-be2b-af62bf06b8b5 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:02.314014 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5ba64d65-aaa4-4595-b52c-9c1e54500f33 req-6d3f831d-5020-4349-be2b-af62bf06b8b5 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0827916
Jun 01 12:40:02.360151 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5ba64d65-aaa4-4595-b52c-9c1e54500f33 req-6f546b04-348c-4eea-ac91-aa919e22f041 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399830
Jun 01 12:40:03.318458 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3425b4cf-131f-4364-b8e9-043b8cf2228c req-f66ded65-f66e-4895-a1fe-781614e59760 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:03.320696 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3425b4cf-131f-4364-b8e9-043b8cf2228c req-f66ded65-f66e-4895-a1fe-781614e59760 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0892394
Jun 01 12:40:03.366184 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3425b4cf-131f-4364-b8e9-043b8cf2228c req-3d2b7765-ebe1-446b-ac68-cb3a95142466 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0396781
Jun 01 12:40:03.551985 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3515c6db-3b98-4a39-9d8b-8dd0a7936fd0 req-2661627b-8f11-4843-96cb-e4e679025704 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:03.554015 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3515c6db-3b98-4a39-9d8b-8dd0a7936fd0 req-2661627b-8f11-4843-96cb-e4e679025704 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0846167
Jun 01 12:40:03.602461 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3515c6db-3b98-4a39-9d8b-8dd0a7936fd0 req-c3ce1977-fe9a-4d81-8285-2694f383f935 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0434444
Jun 01 12:40:04.630324 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09121891-1d04-4bf7-86e6-5b16eb1d7c13 req-775aa431-1c8f-4607-abef-2381cd968141 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:04.631802 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-09121891-1d04-4bf7-86e6-5b16eb1d7c13 req-775aa431-1c8f-4607-abef-2381cd968141 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.1522019
Jun 01 12:40:04.677065 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-09121891-1d04-4bf7-86e6-5b16eb1d7c13 req-c85f6585-a1f9-44c4-ab81-8a4a58b11c83 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391285
Jun 01 12:40:04.854208 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f451c1c8-fbc1-46e3-a529-1b4fd4dbf46d req-f5c62cd6-17e0-4cb9-914c-f47a55847300 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:04.855654 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f451c1c8-fbc1-46e3-a529-1b4fd4dbf46d req-f5c62cd6-17e0-4cb9-914c-f47a55847300 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0820594
Jun 01 12:40:04.899530 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f451c1c8-fbc1-46e3-a529-1b4fd4dbf46d req-b7513814-c93b-495e-833b-8d01c26afa1f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0382848
Jun 01 12:40:05.874249 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b15f94f4-0516-4f5c-a412-8eeab6e49026 req-fa70e83a-3d8f-4c39-b9b1-c317c8c3aa1e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:05.875706 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b15f94f4-0516-4f5c-a412-8eeab6e49026 req-fa70e83a-3d8f-4c39-b9b1-c317c8c3aa1e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0800121
Jun 01 12:40:05.923434 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b15f94f4-0516-4f5c-a412-8eeab6e49026 req-9958d9b5-03e5-409f-8c41-bcb1f1146f27 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0420527
Jun 01 12:40:06.092383 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-045e3673-e391-4044-944d-7998e36e5514 req-9a802694-7dd9-419b-b216-bb1b48859b33 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:06.093890 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-045e3673-e391-4044-944d-7998e36e5514 req-9a802694-7dd9-419b-b216-bb1b48859b33 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0840621
Jun 01 12:40:06.140070 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-045e3673-e391-4044-944d-7998e36e5514 req-e42d071a-e143-4058-8caf-bacd0d429232 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404637
Jun 01 12:40:06.863984 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-93a00f50-7bc7-45a8-a6a1-9f61487ff1b1 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:06.865428 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-93a00f50-7bc7-45a8-a6a1-9f61487ff1b1 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.0784287
Jun 01 12:40:07.005614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Deleting port 30a14b45-81e5-4718-a910-a6b768fc753f {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:07.006344 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:07.114411 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f39210e-0f7c-4fc2-8a4f-070880880d59 req-4a15a5f4-6cf7-427e-84bf-ae113bde21e2 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:07.115824 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6f39210e-0f7c-4fc2-8a4f-070880880d59 req-4a15a5f4-6cf7-427e-84bf-ae113bde21e2 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0806758
Jun 01 12:40:07.140188 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] For port 30a14b45-81e5-4718-a910-a6b768fc753f, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=30a14b45-81e5-4718-a910-a6b768fc753f,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:07.140588 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:07.164979 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6f39210e-0f7c-4fc2-8a4f-070880880d59 req-5ee37404-96e9-4358-95e7-f139b71557dd tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0426846
Jun 01 12:40:07.481257 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:07.481617 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:07.481918 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Floating IP d2d1bbc3-bbff-4db5-abd1-679398f8f782 disassociated. External IP: 172.27.3.172, port: 30a14b45-81e5-4718-a910-a6b768fc753f.
Jun 01 12:40:07.482247 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Calling delete_port for 30a14b45-81e5-4718-a910-a6b768fc753f owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:07.493760 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f134919-fcf9-4136-97d8-ae7ca944f30d req-e699555c-ea1f-4fe3-a151-0f7260c24cd8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:07.495189 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7f134919-fcf9-4136-97d8-ae7ca944f30d req-e699555c-ea1f-4fe3-a151-0f7260c24cd8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 946 time: 0.2068038
Jun 01 12:40:07.551912 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7f134919-fcf9-4136-97d8-ae7ca944f30d req-ea4ecfbc-4638-4f31-80a8-9479b58f28cd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0510309
Jun 01 12:40:07.642083 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:07.647609 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:07.690937 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event deleted for resources: {'Port': ['ID=30a14b45-81e5-4718-a910-a6b768fc753f,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:07.693958 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:07.882521 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:40:08.174786 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:40:08.184788 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:40:08.194894 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:08.195599 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a26992dc0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:39:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:08.252594 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] No DVR routers for this DVR port 30a14b45-81e5-4718-a910-a6b768fc753f on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:40:08.255197 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:08.259346 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'name': 'network-vif-deleted', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:08.262166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af9eccf1-b178-45e6-b5ce-7ca3932b7247" -d '{"events": [{"server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "name": "network-vif-deleted", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:08.275845 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b8fdc5c9-80bc-4992-914a-724ee09140c2 req-ecf6c83e-1a83-4e74-af6d-997c232ebb9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "DELETE /v2.0/ports/30a14b45-81e5-4718-a910-a6b768fc753f HTTP/1.1" status: 204  len: 173 time: 1.4009814
Jun 01 12:40:08.374385 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c6c4b48-5448-41ee-ae3d-3552aa701313 req-8b746d3a-ad1f-4232-a7ad-e226bbca8ca0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:08.375889 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8c6c4b48-5448-41ee-ae3d-3552aa701313 req-8b746d3a-ad1f-4232-a7ad-e226bbca8ca0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0921965
Jun 01 12:40:08.387653 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:08.398986 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2270571c-f048-4f4a-9fbe-32a2f0dad268 x-openstack-request-id: req-2270571c-f048-4f4a-9fbe-32a2f0dad268 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:08.399305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "05712402-0fe8-48cc-9a01-7e79b46accd7", "name": "network-vif-deleted", "tag": "30a14b45-81e5-4718-a910-a6b768fc753f", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:08.399584 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-2270571c-f048-4f4a-9fbe-32a2f0dad268 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:08.399993 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '05712402-0fe8-48cc-9a01-7e79b46accd7', 'name': 'network-vif-deleted', 'tag': '30a14b45-81e5-4718-a910-a6b768fc753f', 'status': 'completed', 'code': 200}
Jun 01 12:40:08.428096 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8c6c4b48-5448-41ee-ae3d-3552aa701313 req-e78272b4-aa44-43b6-8040-fcbfc821fa82 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0462346
Jun 01 12:40:08.721684 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b51b45ab-8333-4ce2-8ecb-4713bfa61975 req-f1a11a26-1220-4dd6-9e26-78e959a04080 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=05712402-0fe8-48cc-9a01-7e79b46accd7 HTTP/1.1" status: 200  len: 210 time: 0.0480306
Jun 01 12:40:08.769700 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a26992dc0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:08.773657 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:40:08.782450 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:08.783042 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a26992dc0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:39:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:08.960029 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:09.283088 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a26992dc0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:09.286880 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e68661fe-fd5c-4ce9-9ef7-7a2722022bc6 None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:40:09.491920 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24f6b17b-dd94-43eb-b12e-185f375bade5 None None] New status for floating IP d2d1bbc3-bbff-4db5-abd1-679398f8f782: DOWN {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:40:09.629900 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a6090a-ddc0-4971-a76c-09ab5632ff08 req-67f3374c-b16c-4c58-ac63-14fccd05d14a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:09.631264 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7a6090a-ddc0-4971-a76c-09ab5632ff08 req-67f3374c-b16c-4c58-ac63-14fccd05d14a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0883889
Jun 01 12:40:09.680296 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7a6090a-ddc0-4971-a76c-09ab5632ff08 req-fd3a04ca-5892-48fa-aefb-51314d3b0eab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0422776
Jun 01 12:40:09.850451 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-52dd96c7-54b7-4c04-915c-cc940433a6c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:10.092844 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-22a5fdd5-db33-4e13-933e-c2eb1c370f5b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-272221243&fields=id&tenant_id=892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 267 time: 0.0403812
Jun 01 12:40:10.159404 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 30a14b45-81e5-4718-a910-a6b768fc753f no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:10.193222 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 30a14b45-81e5-4718-a910-a6b768fc753f {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:10.193488 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 30a14b45-81e5-4718-a910-a6b768fc753f not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:10.242875 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-2a78b8e6-3c88-452d-9b57-15f080e19fa3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:10.244289 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-2a78b8e6-3c88-452d-9b57-15f080e19fa3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 812 time: 0.1448100
Jun 01 12:40:10.259403 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-66178cc1-5577-4ed3-9c0d-b3c35135595d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/quotas/892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 375 time: 0.0091257
Jun 01 12:40:10.345507 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-c1730631-e982-40af-bd5a-a951f704c9ee req-ae6d153c-0657-4263-a397-98f19b112a4a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:40:10.360165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-c1730631-e982-40af-bd5a-a951f704c9ee req-ae6d153c-0657-4263-a397-98f19b112a4a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:40:10.361414 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-ae6d153c-0657-4263-a397-98f19b112a4a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0963802
Jun 01 12:40:10.540078 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-cb989f65-fd88-49cc-8143-2105542ac37f service neutron] 10.222.0.81 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1669476
Jun 01 12:40:10.673872 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-2fbb9cda-bc38-426d-b11d-f5f063f566f3 service neutron] 10.222.0.81 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1272242
Jun 01 12:40:10.873758 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be5edac-e899-4606-b607-2cb8f12f710c req-129e515f-8699-4827-a050-97025d0af138 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:10.875238 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7be5edac-e899-4606-b607-2cb8f12f710c req-129e515f-8699-4827-a050-97025d0af138 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0834517
Jun 01 12:40:10.934471 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7be5edac-e899-4606-b607-2cb8f12f710c req-01611daf-f9d5-44cd-a409-2ff4e8ddf131 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0536234
Jun 01 12:40:11.079749 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-af67f445-07d7-4070-bfbe-e757efb9eb5d req-87dee501-f000-4df7-a0fe-e8b709d7b4e9 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 210 time: 0.0427976
Jun 01 12:40:12.107506 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:12.145407 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae7e1d6-7285-4c6b-9648-27006807848b req-409db395-9fd1-4ea1-b2d8-252fe8c7df53 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:12.147003 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7ae7e1d6-7285-4c6b-9648-27006807848b req-409db395-9fd1-4ea1-b2d8-252fe8c7df53 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.0948908
Jun 01 12:40:12.197292 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7ae7e1d6-7285-4c6b-9648-27006807848b req-fa42dfce-b099-4bdc-8786-dda4952eb2dd tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419946
Jun 01 12:40:12.222272 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-0bc29192-2a91-4a00-a35d-314c59e36952 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:12.223648 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-0bc29192-2a91-4a00-a35d-314c59e36952 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 812 time: 0.1933112
Jun 01 12:40:12.280962 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-eeada25a-d67b-4d8b-ba78-a2483d4ce2e6 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 379 time: 0.0410769
Jun 01 12:40:12.291583 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'port': {'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'admin_state_up': True, 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'security_groups': ['886adde4-fecb-48e7-a65d-8c4b1eef5d0e']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:40:12.332434 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:12.365180 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-359016bd-827d-4fcd-ae63-801c3023456e req-30c2b11a-fe66-4517-adaa-c29a378203dd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 210 time: 0.0593348
Jun 01 12:40:12.432942 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:40:12.442734 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:40:12.452522 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Made reservation on behalf of 892af7572bdb454483d1279dcfc9ccb0 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:40:12.455995 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:12.615157 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Allocated IP 172.20.0.14 (42f63911-56d5-4572-8431-a99e560ca482/056def2a-a8b2-4665-b4ba-cc9e031e8b58/74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:40:12.669287 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f64efbfd-fa5f-453d-9faf-93df3b242499 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:12.804115 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:12.819045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Transition to ACTIVE for port object 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:40:12.843742 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:12.849233 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0435cb32-f088-4955-9cc7-d5f8724e2852 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:13.009601 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Network 42f63911-56d5-4572-8431-a99e560ca482 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:40:13.013152 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:40:13.017217 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:40:13.055501 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:13.064952 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:13.089559 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:13.090190 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:13.116942 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8289793
Jun 01 12:40:13.134393 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Request body: {'port': {'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:40:13.217523 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-1262af85-2f4f-43e8-9435-71f9f533422a None None] Provisioning for port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:40:13.222417 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-1262af85-2f4f-43e8-9435-71f9f533422a None None] Provisioning complete for port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:40:13.222789 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1262af85-2f4f-43e8-9435-71f9f533422a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:13.265070 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:13.286577 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-1262af85-2f4f-43e8-9435-71f9f533422a None None] Port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:40:13.549564 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7cc8e01-69d2-4c4b-8b85-a2e8888d7087 req-2aefb45e-1a18-44c9-b4b6-ddf0276e8015 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:13.551024 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c7cc8e01-69d2-4c4b-8b85-a2e8888d7087 req-2aefb45e-1a18-44c9-b4b6-ddf0276e8015 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 943 time: 0.2280445
Jun 01 12:40:13.560986 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f21d447-7831-4df4-b3a5-1ba11da0b07c req-85824aef-893a-4998-82ce-d60a5c41759d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:13.562633 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4f21d447-7831-4df4-b3a5-1ba11da0b07c req-85824aef-893a-4998-82ce-d60a5c41759d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 932 time: 0.0883737
Jun 01 12:40:13.608459 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4f21d447-7831-4df4-b3a5-1ba11da0b07c req-59f3be26-6307-4566-b410-a66078c5b287 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400398
Jun 01 12:40:13.641558 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c7cc8e01-69d2-4c4b-8b85-a2e8888d7087 req-b1ba16f4-123b-4b73-b8f3-2c699f187265 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0822973
Jun 01 12:40:13.720016 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:40:13.727115 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:13.741000 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Transition to ACTIVE for port object 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:40:13.744217 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:13.747643 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:13.866615 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:13.872081 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Pushing event updated for resources: {'Port': ['ID=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:13.875770 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:13.982288 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Attempting to bind port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:40:13.982612 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Attempting to bind port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:40:13.982930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Attempting to bind port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:40:13.987448 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 on network 42f63911-56d5-4572-8431-a99e560ca482 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:40:13.987769 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Attempting to bind port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:40:13.992891 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 40, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:40:13.993217 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Checking segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:40:13.993592 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Bound using segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:40:13.994006 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Bound port: 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:40:13.994343 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:14.107909 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] For port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:40:14.110840 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] For port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:40:14.115855 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:14.119453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1f12d763-fff6-4ac8-8205-44452731301b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:14.179354 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:14.179955 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:14.181314 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] 10.222.0.95 "PUT /v2.0/ports/74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 HTTP/1.1" status: 200  len: 1094 time: 1.0522435
Jun 01 12:40:14.181795 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:14.184136 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48" -d '{"events": [{"name": "network-changed", "server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:14.185093 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:40:14.207921 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Pushing event updated for resources: {'Port': ['ID=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:14.219559 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:14.257777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6d0ab147-29ab-43ee-864e-e3662bb674e6 x-openstack-request-id: req-6d0ab147-29ab-43ee-864e-e3662bb674e6 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:14.258100 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:14.258371 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-6d0ab147-29ab-43ee-864e-e3662bb674e6 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:14.258780 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'status': 'completed', 'code': 200}
Jun 01 12:40:14.302600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-b3dfd084-b741-47a1-a508-9849e9b16e6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:14.304373 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-b3dfd084-b741-47a1-a508-9849e9b16e6d service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 1097 time: 0.0783575
Jun 01 12:40:14.343841 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:14.364710 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'port_id': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'mac_address': 'fa:16:3e:ed:6f:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 756, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:40:14.379536 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-f87b910d-41f7-444e-b92c-324306ee3372 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 HTTP/1.1" status: 200  len: 217 time: 0.0663102
Jun 01 12:40:14.420203 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:14.442891 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dd8500c8-5962-4478-9c99-20281668d7c6 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:40:14.448574 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-36c95f20-5c5e-4110-a8db-7448cd9f0e0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:14.449432 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-36c95f20-5c5e-4110-a8db-7448cd9f0e0c service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0625620
Jun 01 12:40:14.465189 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:14.469493 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:14.471346 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:14.537521 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1730631-e982-40af-bd5a-a951f704c9ee req-d4061810-ae2a-4c08-b41f-cdf0e6110761 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:14.538974 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-d4061810-ae2a-4c08-b41f-cdf0e6110761 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0795076
Jun 01 12:40:14.539883 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=9']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:14.547016 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.547359 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.547766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.548092 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.548411 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.548755 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.549074 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.549389 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.549791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.550016 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.550320 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.550631 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:14.554286 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:14.675639 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-8f9f0a4a-4a27-451f-9b82-5ecbdd10d8c7 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1269119
Jun 01 12:40:14.727363 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['dd8500c8-5962-4478-9c99-20281668d7c6'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:40:14.824176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff400b29-c463-409f-8d00-9b9f953bae6b req-bcd8f39f-df9b-4a00-900b-9f8ac060dcda tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:14.825882 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ff400b29-c463-409f-8d00-9b9f953bae6b req-bcd8f39f-df9b-4a00-900b-9f8ac060dcda tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 944 time: 0.1096659
Jun 01 12:40:14.879768 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ff400b29-c463-409f-8d00-9b9f953bae6b req-6c46eb5a-314b-493b-9094-d5753586c56f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0475123
Jun 01 12:40:14.951723 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c1730631-e982-40af-bd5a-a951f704c9ee req-e7b2ee1c-a0bb-4ccb-8b13-34d345714e39 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2691240
Jun 01 12:40:14.973148 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5c7963-e957-4d68-af87-38cf4e2901bd req-280f0144-49f0-460c-a601-25667e9757cb tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:14.974779 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b5c7963-e957-4d68-af87-38cf4e2901bd req-280f0144-49f0-460c-a601-25667e9757cb tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 944 time: 0.2098687
Jun 01 12:40:15.074379 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b5c7963-e957-4d68-af87-38cf4e2901bd req-7794893e-2be0-44d0-8f25-2a0fc813a2c9 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0930874
Jun 01 12:40:15.093210 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-c844aae7-0cef-47b8-bdcd-06e27e603982 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:15.094637 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-c844aae7-0cef-47b8-bdcd-06e27e603982 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 1097 time: 0.0947938
Jun 01 12:40:15.226828 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-e623f2f3-4119-4983-82f8-e4420b7b9704 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:15.228233 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-e623f2f3-4119-4983-82f8-e4420b7b9704 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1267099
Jun 01 12:40:15.297415 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-11828506-5d64-4f67-a0fd-3e9b9fb0c4e2 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 HTTP/1.1" status: 200  len: 217 time: 0.0623631
Jun 01 12:40:15.359426 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-ff09fd74-3d98-4f7d-bc3c-ba00b230f953 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:15.360751 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-ff09fd74-3d98-4f7d-bc3c-ba00b230f953 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0563550
Jun 01 12:40:15.406597 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:15.436279 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-8b2fc2ec-16d3-4784-b7ee-1e0db5fc2a44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:15.437850 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-8b2fc2ec-16d3-4784-b7ee-1e0db5fc2a44 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0697665
Jun 01 12:40:15.569783 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-824ee502-91da-41a0-8afa-301b7c6fee1f service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1242135
Jun 01 12:40:15.700422 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5bb74be4-a6b0-4ab3-bfe0-b2b717883c48 req-d244cab6-7c62-4ec1-9426-4d98bb9822b8 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1235812
Jun 01 12:40:16.064687 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36fd699-bc72-4980-8e92-b3a88f70636a req-ec78b307-ff25-47a2-83b7-5fb2ec294db0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:16.065363 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-a36fd699-bc72-4980-8e92-b3a88f70636a req-ec78b307-ff25-47a2-83b7-5fb2ec294db0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:40:16.080799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-a36fd699-bc72-4980-8e92-b3a88f70636a req-ec78b307-ff25-47a2-83b7-5fb2ec294db0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:40:16.082021 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a36fd699-bc72-4980-8e92-b3a88f70636a req-ec78b307-ff25-47a2-83b7-5fb2ec294db0 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 944 time: 0.0970869
Jun 01 12:40:16.127464 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a36fd699-bc72-4980-8e92-b3a88f70636a req-75d040bb-70ff-4c2d-ba54-da682252fa6f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394144
Jun 01 12:40:16.176701 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:40:16.269627 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa65f94-6c2f-44a4-bd75-93dfd6a86948 req-2b9e3d8a-b498-4d75-8cee-22a4d065604f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:16.272049 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9aa65f94-6c2f-44a4-bd75-93dfd6a86948 req-2b9e3d8a-b498-4d75-8cee-22a4d065604f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 944 time: 0.0840178
Jun 01 12:40:16.283966 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port dd8500c8-5962-4478-9c99-20281668d7c6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:40:16.284340 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:16.318143 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9aa65f94-6c2f-44a4-bd75-93dfd6a86948 req-a7756655-1c7a-4f0f-ae2d-2e11c551e520 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397990
Jun 01 12:40:16.399198 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:16.426187 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:16.428559 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2a7ad91d-8128-4ff1-9402-c8a18eadca36" -d '{"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-plugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:16.435938 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:16.440058 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:16.441902 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:16.507614 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=10']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:16.511266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:16.525079 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec5ac85b-2413-40a3-aaad-b213736cb27d x-openstack-request-id: req-ec5ac85b-2413-40a3-aaad-b213736cb27d {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:16.525373 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-plugged", "status": "completed", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:16.525626 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-ec5ac85b-2413-40a3-aaad-b213736cb27d {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:16.526010 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'code': 200}
Jun 01 12:40:17.068038 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e67f1f-9080-4581-b7b4-f31d049e9520 req-15a0d4b2-60e9-40d1-ada8-659dc97ccf86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:17.069701 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37e67f1f-9080-4581-b7b4-f31d049e9520 req-15a0d4b2-60e9-40d1-ada8-659dc97ccf86 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1099 time: 0.0722218
Jun 01 12:40:17.109260 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37e67f1f-9080-4581-b7b4-f31d049e9520 req-608d02a0-b9b9-4ca6-bfd9-f478ff746b9e service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0324700
Jun 01 12:40:17.313010 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-827010c4-4277-40e7-8597-76e15d9881e0 req-9d437fe4-fd5e-4e1a-b574-5d343618c404 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:17.314519 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-827010c4-4277-40e7-8597-76e15d9881e0 req-9d437fe4-fd5e-4e1a-b574-5d343618c404 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 944 time: 0.0798383
Jun 01 12:40:17.359742 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-827010c4-4277-40e7-8597-76e15d9881e0 req-45a1095c-fddf-44d8-a6d4-b4f2e1022783 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393410
Jun 01 12:40:17.598524 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508fa116-b0ee-4d38-a1ac-67fdf8ab57e6 req-23290c91-de8d-4a01-8fa8-0ce1f420eed3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:17.599994 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-508fa116-b0ee-4d38-a1ac-67fdf8ab57e6 req-23290c91-de8d-4a01-8fa8-0ce1f420eed3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 946 time: 0.1679418
Jun 01 12:40:17.643936 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-508fa116-b0ee-4d38-a1ac-67fdf8ab57e6 req-4bf07a50-38a8-471e-b6e6-1b77799441d1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381246
Jun 01 12:40:18.550355 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e47ba4a6-6c4b-4be9-8992-95815e340381 req-3b62512c-0494-4c11-b718-48779569e899 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:18.551826 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e47ba4a6-6c4b-4be9-8992-95815e340381 req-3b62512c-0494-4c11-b718-48779569e899 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 944 time: 0.0858240
Jun 01 12:40:18.601333 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e47ba4a6-6c4b-4be9-8992-95815e340381 req-bd82186f-34b4-4172-a284-53a8ed537750 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0436053
Jun 01 12:40:18.842818 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e53134-b21e-4d7c-9886-324fc7988d56 req-860b8bd8-f474-440f-a9dd-6cfa59cccd3c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:18.844281 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f9e53134-b21e-4d7c-9886-324fc7988d56 req-860b8bd8-f474-440f-a9dd-6cfa59cccd3c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 946 time: 0.0873935
Jun 01 12:40:18.889001 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f9e53134-b21e-4d7c-9886-324fc7988d56 req-f86b33c2-ee88-4e18-b008-17ee28fabe9c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388904
Jun 01 12:40:19.782922 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee5543c9-d1f1-42de-ba3d-567e3d5c5d90 req-2d461f26-15df-4ae6-9add-046a38320fab tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:19.784335 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee5543c9-d1f1-42de-ba3d-567e3d5c5d90 req-2d461f26-15df-4ae6-9add-046a38320fab tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 944 time: 0.0775056
Jun 01 12:40:19.828460 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ee5543c9-d1f1-42de-ba3d-567e3d5c5d90 req-0437796f-26b1-441c-a5cb-fe6bed6125f2 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385411
Jun 01 12:40:20.080948 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa9cca4-13ef-4be4-ac05-1f58979d5fcf req-a2251f71-d2d9-4a2a-a7a7-d32bff6fa13e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:20.082440 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6aa9cca4-13ef-4be4-ac05-1f58979d5fcf req-a2251f71-d2d9-4a2a-a7a7-d32bff6fa13e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 946 time: 0.0808034
Jun 01 12:40:20.127542 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6aa9cca4-13ef-4be4-ac05-1f58979d5fcf req-78b3bb69-e8b2-4641-ad3c-ffe468be43b8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395982
Jun 01 12:40:21.018287 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0920a83d-f0df-4050-a2bd-de0ecd2c3d4b req-9d718c95-5970-4003-8871-37fdb9bc09d9 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:21.019724 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0920a83d-f0df-4050-a2bd-de0ecd2c3d4b req-9d718c95-5970-4003-8871-37fdb9bc09d9 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 944 time: 0.0849264
Jun 01 12:40:21.064199 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0920a83d-f0df-4050-a2bd-de0ecd2c3d4b req-774090fb-1918-4ca5-80ee-696020e5578b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388658
Jun 01 12:40:22.203241 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:40:22.250070 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd40969c-cc29-4fc7-b092-0bff188725ac req-55edaa12-3154-4d0e-90ee-67b5225c1bfe tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:22.251517 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bd40969c-cc29-4fc7-b092-0bff188725ac req-55edaa12-3154-4d0e-90ee-67b5225c1bfe tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 944 time: 0.0814161
Jun 01 12:40:22.305792 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bd40969c-cc29-4fc7-b092-0bff188725ac req-4ae7680b-46fb-469b-a243-b6033237ef6d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0479138
Jun 01 12:40:22.343217 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:22.356125 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 759, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:40:22.416689 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:22.433909 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:40:22.449895 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:22.453741 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:22.456494 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:22.526550 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:22.529790 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:22.751420 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:40:22.786127 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c1fbc9-313d-4179-93e7-bf216338df5b req-1c1e0c77-ee57-49ec-9f42-0d4179200f67 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:22.787626 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-14c1fbc9-313d-4179-93e7-bf216338df5b req-1c1e0c77-ee57-49ec-9f42-0d4179200f67 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0848086
Jun 01 12:40:22.838016 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-14c1fbc9-313d-4179-93e7-bf216338df5b req-b3f1690e-d76b-4c17-9fb7-e49fbb747a9c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402155
Jun 01 12:40:23.493008 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b92ebe9-35ac-4da0-9b1c-2d7e10b39889 req-b47a7a8b-cd4c-44bc-8f4e-e446aea27bbd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:23.494460 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6b92ebe9-35ac-4da0-9b1c-2d7e10b39889 req-b47a7a8b-cd4c-44bc-8f4e-e446aea27bbd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 945 time: 0.0805855
Jun 01 12:40:23.539102 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6b92ebe9-35ac-4da0-9b1c-2d7e10b39889 req-726531d3-cef9-48b2-87d1-4d959f1efc94 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389047
Jun 01 12:40:24.025293 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10726868-2431-426b-ab0e-3b617c92fda4 req-de946e8f-7d68-4cba-bc93-9b216b519c80 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:24.027964 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-10726868-2431-426b-ab0e-3b617c92fda4 req-de946e8f-7d68-4cba-bc93-9b216b519c80 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0827529
Jun 01 12:40:24.073678 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-10726868-2431-426b-ab0e-3b617c92fda4 req-a7d1979e-4309-4dc7-ae2f-15d696a96a6c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0400817
Jun 01 12:40:24.205258 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:40:24.273214 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:40:24.277634 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:40:24.277999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:24.391636 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:24.417759 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:24.419945 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49cbf628-a6a5-4b58-8a57-29a05bf380ca" -d '{"events": [{"server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "name": "network-vif-plugged", "status": "completed", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:24.428143 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:24.433006 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:24.434815 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:24.470503 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54e3d38a-a564-4d90-a0e9-7bfd5304a405 x-openstack-request-id: req-54e3d38a-a564-4d90-a0e9-7bfd5304a405 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:24.470836 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "name": "network-vif-plugged", "status": "completed", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:24.471078 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-54e3d38a-a564-4d90-a0e9-7bfd5304a405 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:24.471439 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'code': 200}
Jun 01 12:40:24.504231 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:24.508947 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:24.861554 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18b100a6-7dcd-4561-bb66-37b3f21e4963 req-44d1c952-28ee-4042-a2dd-1a8144bf7727 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:24.863005 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-18b100a6-7dcd-4561-bb66-37b3f21e4963 req-44d1c952-28ee-4042-a2dd-1a8144bf7727 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.2090921
Jun 01 12:40:24.891518 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d67dfe82-18f6-40f3-9b5c-891f90555131 req-c3e06a73-a441-4313-b269-e6064934c1f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:24.892935 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d67dfe82-18f6-40f3-9b5c-891f90555131 req-c3e06a73-a441-4313-b269-e6064934c1f6 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 1099 time: 0.1119580
Jun 01 12:40:24.927622 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-18b100a6-7dcd-4561-bb66-37b3f21e4963 req-bf12c569-e45a-4ba1-8f82-4eff8b40c9e7 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0587053
Jun 01 12:40:24.949827 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d67dfe82-18f6-40f3-9b5c-891f90555131 req-5d54ab5d-6dca-4ffa-b3ec-0806ed61069e service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0438716
Jun 01 12:40:25.410725 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92de0400-6237-4733-9c40-f55c507d59bc req-107778cc-08f5-4d7f-87c6-9efa59e8ebc3 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:25.412174 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-92de0400-6237-4733-9c40-f55c507d59bc req-107778cc-08f5-4d7f-87c6-9efa59e8ebc3 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0834990
Jun 01 12:40:25.456370 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-92de0400-6237-4733-9c40-f55c507d59bc req-f98a7b1b-d9e3-400b-8e11-1947a0020c4e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0377135
Jun 01 12:40:26.116163 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea64398b-fb00-471a-b01c-0c152ca495ef req-2bf6fe21-0c83-4a99-939b-bc1e4c7bd904 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:26.117669 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ea64398b-fb00-471a-b01c-0c152ca495ef req-2bf6fe21-0c83-4a99-939b-bc1e4c7bd904 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.0840030
Jun 01 12:40:26.174438 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ea64398b-fb00-471a-b01c-0c152ca495ef req-964a325e-9ec4-45d2-8fcc-92efe1be45e8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497007
Jun 01 12:40:26.640955 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66344c29-68b4-4ba5-8432-6c5d3aee115b req-5808ebb1-7bdd-4b69-941e-9951cc1d199a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:26.642385 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-66344c29-68b4-4ba5-8432-6c5d3aee115b req-5808ebb1-7bdd-4b69-941e-9951cc1d199a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0790110
Jun 01 12:40:26.686494 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-66344c29-68b4-4ba5-8432-6c5d3aee115b req-50f732f0-ae16-4474-bb92-e66364a77c6a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0385120
Jun 01 12:40:27.363493 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b9fdc8-4eef-4848-a1fa-9e4b3c5e5c1d req-76d6d02d-b15c-402c-85c3-a20590503542 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:27.364937 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-07b9fdc8-4eef-4848-a1fa-9e4b3c5e5c1d req-76d6d02d-b15c-402c-85c3-a20590503542 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.0828838
Jun 01 12:40:27.409442 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-07b9fdc8-4eef-4848-a1fa-9e4b3c5e5c1d req-7f25e12c-464e-4720-bfef-f3f6c829d94b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387580
Jun 01 12:40:27.592940 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f9e4ae-340c-4baf-af00-5e539efe6805 req-9972249d-c6bb-4772-8c24-6d33297ce25c tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:27.594377 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-37f9e4ae-340c-4baf-af00-5e539efe6805 req-9972249d-c6bb-4772-8c24-6d33297ce25c tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.0797229
Jun 01 12:40:27.638645 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-37f9e4ae-340c-4baf-af00-5e539efe6805 req-059f6052-217f-4829-b872-c037ebf9d840 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0386276
Jun 01 12:40:27.661568 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34022) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:27.735229 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aee18856-9b06-4d59-a8d8-b63f955ec368 tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:27.736761 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-aee18856-9b06-4d59-a8d8-b63f955ec368 tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 1094 time: 0.0736208
Jun 01 12:40:27.739505 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34028) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:27.744323 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address': '172.20.0.14'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:40:27.750729 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:40:27.754552 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:floatingip and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:40:27.757450 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:40:27.763651 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:40:27.773962 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:27.949321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ddd3665-c99b-4a14-8587-0de31acc4b74 req-2d513167-de9d-4bcb-a78c-87cf28b88ebe tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:27.950783 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9ddd3665-c99b-4a14-8587-0de31acc4b74 req-2d513167-de9d-4bcb-a78c-87cf28b88ebe tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.1567631
Jun 01 12:40:28.019240 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9ddd3665-c99b-4a14-8587-0de31acc4b74 req-7012ece6-4e15-47e1-a6c8-8a12dacbfca2 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0621383
Jun 01 12:40:28.021809 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:28.163329 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Allocated IP 172.27.3.126 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/e013d702-bc77-4b8c-b5c7-364ef17b4e1b) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:40:28.309537 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:28.337716 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:28.341730 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:28.403130 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:40:28.405994 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:40:28.409579 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:40:28.441221 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=e013d702-bc77-4b8c-b5c7-364ef17b4e1b,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:28.459908 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.460264 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.460639 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.460987 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.461322 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.461659 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.461991 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.462323 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.462653 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.462982 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.463954 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.464281 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:28.468785 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:28.809319 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-1107adb0-3661-4e31-a83c-9bac7a9e2aab tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1566501766&fields=id&tenant_id=c9f26a8407554421b6fc3162658b8a00 HTTP/1.1" status: 200  len: 267 time: 0.0592411
Jun 01 12:40:28.921974 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-769442a2-ba5a-4556-961c-030b09db5aea tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:28.923426 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-769442a2-ba5a-4556-961c-030b09db5aea tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 984 time: 0.1085188
Jun 01 12:40:28.927632 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:28.938706 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Request body: {'port': {'security_groups': ['b4540638-fbb0-447a-9b8e-046c38d5174a']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:40:29.205631 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.214607 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0cce06b-a223-462b-9a33-1f5a28e32746 req-e4738f8c-0d71-4b93-b072-501174ac797a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:29.216123 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f0cce06b-a223-462b-9a33-1f5a28e32746 req-e4738f8c-0d71-4b93-b072-501174ac797a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0879230
Jun 01 12:40:29.230887 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.261808 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f0cce06b-a223-462b-9a33-1f5a28e32746 req-0ea28e1e-58ed-4725-a4a1-63147b63f071 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399380
Jun 01 12:40:29.664475 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:29.678930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.687149 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.692800 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dd3589f5-4f99-47eb-978d-9204d7d6857a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:29.749238 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.786018 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.805401 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d93addc7-07f1-4d9e-8775-05a3301e8f0e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:40:29.826617 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=e013d702-bc77-4b8c-b5c7-364ef17b4e1b,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:29.834357 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:29.834600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.836001 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ceed622c-ec57-463a-adca-5e10ba1f48a9 req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "PUT /v2.0/ports/d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 942 time: 0.9061153
Jun 01 12:40:29.839377 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:29.841739 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6031b8c1-2965-43aa-9f91-a63698280063" -d '{"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:29.843533 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34040) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:29.844715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:29.848476 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.050s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:29.904825 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.942450 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.973591 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dde20557-d226-44f4-9c8a-0e673fc2432e x-openstack-request-id: req-dde20557-d226-44f4-9c8a-0e673fc2432e {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:29.973978 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:29.974171 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-dde20557-d226-44f4-9c8a-0e673fc2432e {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:29.974584 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'status': 'completed', 'code': 200}
Jun 01 12:40:29.978671 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:29.993799 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d93addc7-07f1-4d9e-8775-05a3301e8f0e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:40:30.062213 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event updated for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=7']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:30.075062 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:30.077233 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:30.082380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6806adff-286f-4ee6-b0bb-6237be448fb1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:30.096336 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d6313c3-d5a9-4821-91a9-8d9461d2e507,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:30.106594 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.106977 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.107345 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.107707 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.108067 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.108425 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.109219 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.109219 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.109494 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.109849 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.110202 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.110544 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:40:30.116573 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:30.118629 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:30.120084 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "DELETE /v2.0/security-groups/3d6313c3-d5a9-4821-91a9-8d9461d2e507 HTTP/1.1" status: 204  len: 168 time: 0.2743192
Jun 01 12:40:30.123035 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34046) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:30.186271 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Floating IP 8857f6b8-23b3-44b5-a664-658660ca4acf associated. External IP: 172.27.3.126, port: 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887.
Jun 01 12:40:30.227085 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-5f34d874-2988-4643-a2c1-4e9792e1cad9 None None] Provisioning complete for port d93addc7-07f1-4d9e-8775-05a3301e8f0e triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:40:30.227463 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5f34d874-2988-4643-a2c1-4e9792e1cad9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:30.254472 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6031b8c1-2965-43aa-9f91-a63698280063 req-bad452de-3fe3-401d-b27a-450809e5e406 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:30.256551 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6031b8c1-2965-43aa-9f91-a63698280063 req-bad452de-3fe3-401d-b27a-450809e5e406 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1098 time: 0.2929444
Jun 01 12:40:30.406517 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Deleting port 22d18bb8-1d34-4355-ab05-0c5b2926d395 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:30.407016 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:30.533818 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:30.534141 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:30.663561 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Calling delete_port for 22d18bb8-1d34-4355-ab05-0c5b2926d395 owned by network:floatingip {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:30.688672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6031b8c1-2965-43aa-9f91-a63698280063 req-65fbde95-75df-4e83-9b7b-9d48a4506149 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:30.690110 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6031b8c1-2965-43aa-9f91-a63698280063 req-65fbde95-75df-4e83-9b7b-9d48a4506149 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 916 time: 0.4197614
Jun 01 12:40:30.794056 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:30.797784 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ec8dbf69-b0a5-4c78-bce0-58178a99eb11 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:30.897513 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ab181b-935a-46e4-9b85-989cdb2d4258 req-51a01ee5-814a-444e-a2ae-45cd278f8e1c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:30.899097 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c7ab181b-935a-46e4-9b85-989cdb2d4258 req-51a01ee5-814a-444e-a2ae-45cd278f8e1c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.4693582
Jun 01 12:40:30.900988 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6031b8c1-2965-43aa-9f91-a63698280063 req-6b283c26-8a78-4e95-9ea5-3fd6a9d3e11e service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 1000 time: 0.2021804
Jun 01 12:40:30.936558 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event deleted for resources: {'Port': ['ID=22d18bb8-1d34-4355-ab05-0c5b2926d395,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:30.941727 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:31.017727 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c7ab181b-935a-46e4-9b85-989cdb2d4258 req-d5d1be2d-b40e-440b-a2c0-89f13ad075b3 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1091688
Jun 01 12:40:31.021287 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:40:31.023137 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6031b8c1-2965-43aa-9f91-a63698280063 req-c3df7edd-3ed3-4d5c-8934-6903aee99c26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:31.024466 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6031b8c1-2965-43aa-9f91-a63698280063 req-c3df7edd-3ed3-4d5c-8934-6903aee99c26 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 200  len: 854 time: 0.1119044
Jun 01 12:40:31.028847 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks [] for floatingip, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:31.029168 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.l3_db [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Floating IP 45919513-0043-4aab-a6c6-b8268504d048 disassociated (deleted). External IP: 172.27.3.64, port: d93addc7-07f1-4d9e-8775-05a3301e8f0e.
Jun 01 12:40:31.260056 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6031b8c1-2965-43aa-9f91-a63698280063 req-cc899d19-6d57-49f3-bbbc-1dd6f316fa26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:31.261547 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6031b8c1-2965-43aa-9f91-a63698280063 req-cc899d19-6d57-49f3-bbbc-1dd6f316fa26 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2288506
Jun 01 12:40:31.264022 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:40:31.276273 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:40:31.285864 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:31.286570 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25eba550>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:31.358403 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:31.386680 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Router 43f207c7-1198-400a-9361-6f9c7b4a3880 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:40:31.448635 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 3.6964841
Jun 01 12:40:31.471330 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:31.474418 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6031b8c1-2965-43aa-9f91-a63698280063 req-4f78b1b0-1f42-4ccc-90fa-b05730cc57c1 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2025094
Jun 01 12:40:31.574626 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:40:31.586788 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] Sync routers for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:40:31.599510 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:31.601899 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b78670>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:31.622699 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:31.669182 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6031b8c1-2965-43aa-9f91-a63698280063 req-e8bb77cc-df60-4fcd-a50a-f1a5309ad13e service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1874609
Jun 01 12:40:31.712772 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "DELETE /v2.0/floatingips/45919513-0043-4aab-a6c6-b8268504d048 HTTP/1.1" status: 204  len: 168 time: 1.5857868
Jun 01 12:40:31.712772 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e'}] {{(pid=91978) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:31.713441 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08332f069cdff5b13479b061d6bbe376049db186f7bff4c04e61a4b86035db55" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b1add3e-3c1b-4096-8d63-3825e0e3d548" -d '{"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e"}]}' {{(pid=91978) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:31.835784 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:31.846408 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b1fc625-4142-40c5-9917-67da23c58a0c x-openstack-request-id: req-4b1fc625-4142-40c5-9917-67da23c58a0c {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:31.846732 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e", "status": "completed", "code": 200}]} {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:31.847020 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-4b1fc625-4142-40c5-9917-67da23c58a0c {{(pid=91978) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:31.847634 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'status': 'completed', 'code': 200}
Jun 01 12:40:31.902888 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25eba550>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:28Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:31.907709 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:40:31.917499 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:31.918209 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25eba550>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:31.973482 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-1ba31155-031b-4e14-9274-26e4cb74d081 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:31.974998 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-1ba31155-031b-4e14-9274-26e4cb74d081 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=c9f26a8407554421b6fc3162658b8a00&device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 1098 time: 0.0878656
Jun 01 12:40:31.975575 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:31.979559 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2dea3ce2-014f-4343-96cb-413ea8afd1d3" -d '{"events": [{"name": "network-changed", "server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:32.057794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-06023afc-daec-48b9-a557-07c203a95795 x-openstack-request-id: req-06023afc-daec-48b9-a557-07c203a95795 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:32.058111 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:32.058392 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-06023afc-daec-48b9-a557-07c203a95795 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:32.058991 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'status': 'completed', 'code': 200}
Jun 01 12:40:32.203683 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:32.279804 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-d2b88dc8-0537-45c6-aa75-ea9f57d7cb49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:32.283540 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-d2b88dc8-0537-45c6-aa75-ea9f57d7cb49 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 200  len: 916 time: 0.3007143
Jun 01 12:40:32.342376 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b78670>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:32.347066 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] Checking router: 43f207c7-1198-400a-9361-6f9c7b4a3880 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:40:32.356194 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:32.356826 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25b78670>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:32.357940 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19134450-cbf9-41b2-8c2a-b1a6619e62aa req-aae74fc5-7edd-4f24-8dd4-10c0913c7072 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:32.365618 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-19134450-cbf9-41b2-8c2a-b1a6619e62aa req-aae74fc5-7edd-4f24-8dd4-10c0913c7072 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.1224589
Jun 01 12:40:32.370607 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-8ba4c717-323a-4949-a036-e97ab97728d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:32.372261 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-8ba4c717-323a-4949-a036-e97ab97728d5 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 1099 time: 0.2946632
Jun 01 12:40:32.380582 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-7b3e9d48-f649-4339-8e82-3e2aecb866b0 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 200  len: 217 time: 0.0848632
Jun 01 12:40:32.422174 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-19134450-cbf9-41b2-8c2a-b1a6619e62aa req-3b8d1345-c44f-4c15-857a-306bca42b0ff tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0554154
Jun 01 12:40:32.547513 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:32.580342 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25eba550>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:28Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:32.584548 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13524451-25ef-4f1a-8014-5504dcde062f None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:28Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:40:32.635191 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-b3b176a3-c451-4793-8833-abb63c445d8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:32.636684 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-b3b176a3-c451-4793-8833-abb63c445d8b service neutron] 10.222.0.95 "GET /v2.0/subnets?id=6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 200  len: 854 time: 0.0892017
Jun 01 12:40:32.696873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-5e1305f1-93bb-4b38-a13a-fc719ad762c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:32.700840 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-5e1305f1-93bb-4b38-a13a-fc719ad762c3 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.3172524
Jun 01 12:40:32.823436 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7211fc08-d7fc-497e-bb02-45b6daa45c2c None None] New status for floating IP 8857f6b8-23b3-44b5-a664-658660ca4acf: ACTIVE {{(pid=91980) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:40:32.854788 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-7c1e30cb-e376-4917-8c60-bab954f94a19 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 HTTP/1.1" status: 200  len: 1000 time: 0.1374979
Jun 01 12:40:32.862323 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-2e474d0e-87ab-4877-a333-081161cdf7a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:32.863989 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-2e474d0e-87ab-4877-a333-081161cdf7a0 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2157049
Jun 01 12:40:32.922796 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25b78670>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:32.927109 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1938ed40-0cd9-4cb5-ab0f-fcf104375d99 None None] The sync data for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi is: [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:38:07Z', 'revision_number': 4, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '1fb85678-c033-49a9-9d95-b4981b00a7a1', 'name': '', 'network_id': 'a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'mac_address': 'fa:16:3e:b8:2f:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_interface', 'standard_attr_id': 523, 'fixed_ips': [{'subnet_id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:06Z', 'updated_at': '2021-06-01T12:38:17Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'subnets': [{'id': '6cb03821-94fa-4f9d-a846-04af6674699b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:40:33.020863 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-3d8a9408-17ac-46ff-9d55-194118054bbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:33.022762 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-3d8a9408-17ac-46ff-9d55-194118054bbd service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1098 time: 0.1440754
Jun 01 12:40:33.069491 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-f322f528-c3df-47d1-9fc0-0035ef6e4242 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:33.070957 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-f322f528-c3df-47d1-9fc0-0035ef6e4242 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.1693559
Jun 01 12:40:33.196909 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-3ffd3f85-dc5c-467d-b67c-0eb384e9b2f8 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3184698
Jun 01 12:40:33.248414 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-89735f73-16f9-4383-9004-080dc84968ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:33.259410 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-89735f73-16f9-4383-9004-080dc84968ee service neutron] 10.222.0.95 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 907 time: 0.2288637
Jun 01 12:40:33.343519 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8110fbaf-74f7-4d0c-85d8-7cdaef6ca62a None None] New status for floating IP 45919513-0043-4aab-a6c6-b8268504d048: DOWN {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:40:33.414937 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4b1add3e-3c1b-4096-8d63-3825e0e3d548 req-4dd60737-1e1f-42c6-a80d-41f987fb4611 service neutron] 10.222.0.95 "GET /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2080138
Jun 01 12:40:33.420282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-3cd5a30c-b3e6-4cae-b707-cc68b29fc70d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:33.421878 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-3cd5a30c-b3e6-4cae-b707-cc68b29fc70d service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3425303
Jun 01 12:40:33.437449 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-06bf361e-d690-4872-84bf-c70f3eed9998 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 1001 time: 0.1702940
Jun 01 12:40:33.540317 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-ee2c6d45-1019-436c-82f3-69ad11915e4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:33.542116 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-ee2c6d45-1019-436c-82f3-69ad11915e4d service neutron] 10.222.0.95 "GET /v2.0/subnets?id=167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 200  len: 845 time: 0.0953734
Jun 01 12:40:33.621520 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-cc8b85bf-9eef-4463-977d-5c0b70ae7527 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1917989
Jun 01 12:40:33.642873 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-5dd6bb33-6172-4cc8-bcf8-3c905d50783f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:33.644312 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-5dd6bb33-6172-4cc8-bcf8-3c905d50783f service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=8c58f5e9-2554-475d-a254-a02b35fda51b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0949059
Jun 01 12:40:33.840199 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-4db066e7-22b2-4599-a005-b6f527a81f51 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1893082
Jun 01 12:40:33.865560 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae20652-7a5f-4581-b477-bdfef6bcb8d4 req-b7ccefb0-94ae-4d78-bda7-7a6e361b6a95 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:33.867073 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-dae20652-7a5f-4581-b477-bdfef6bcb8d4 req-b7ccefb0-94ae-4d78-bda7-7a6e361b6a95 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.2196882
Jun 01 12:40:33.868971 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2dea3ce2-014f-4343-96cb-413ea8afd1d3 req-09f14253-6dd6-4c29-a100-556773963ffc service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2405739
Jun 01 12:40:33.921949 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-dae20652-7a5f-4581-b477-bdfef6bcb8d4 req-95566834-ba4b-4491-8ee8-01b2019dd312 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459020
Jun 01 12:40:34.107145 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cbd5d4bc-5502-40e9-8321-4a10c05f9aa6 req-79ca2201-6792-4e02-8c62-6beebff5851c service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2562168
Jun 01 12:40:35.123030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed75014-ea0d-46d0-9bcb-214e64e802b2 req-6552ded5-e8ed-40bb-ab54-ce9d0ce9b424 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:35.124682 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5ed75014-ea0d-46d0-9bcb-214e64e802b2 req-6552ded5-e8ed-40bb-ab54-ce9d0ce9b424 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0856397
Jun 01 12:40:35.170780 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5ed75014-ea0d-46d0-9bcb-214e64e802b2 req-4dcf6631-c14b-4478-bbd8-1bbe743937e9 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398393
Jun 01 12:40:35.563140 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14175822-2c75-4c89-bbd8-636150a02bb8 req-f696f44d-4f16-4f7d-bd39-b2d27cdbb023 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:35.563766 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-14175822-2c75-4c89-bbd8-636150a02bb8 req-f696f44d-4f16-4f7d-bd39-b2d27cdbb023 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Synchronizing usage tracker for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:40:35.578991 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-14175822-2c75-4c89-bbd8-636150a02bb8 req-f696f44d-4f16-4f7d-bd39-b2d27cdbb023 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Unset dirty status for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:40:35.580401 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-14175822-2c75-4c89-bbd8-636150a02bb8 req-f696f44d-4f16-4f7d-bd39-b2d27cdbb023 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.1000333
Jun 01 12:40:35.623962 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-14175822-2c75-4c89-bbd8-636150a02bb8 req-89b9d3f5-94a8-4d96-a2b2-88b2efa2a82b tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Synchronizing usage tracker for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:40:35.638382 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-14175822-2c75-4c89-bbd8-636150a02bb8 req-89b9d3f5-94a8-4d96-a2b2-88b2efa2a82b tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Unset dirty status for tenant:c9f26a8407554421b6fc3162658b8a00 on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:40:35.639596 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-14175822-2c75-4c89-bbd8-636150a02bb8 req-89b9d3f5-94a8-4d96-a2b2-88b2efa2a82b tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0535624
Jun 01 12:40:36.370405 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17542cdb-bf7d-492f-ba13-8252f564a16b req-109d4b61-b71e-44db-a429-5ed89a63446a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:36.371958 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-17542cdb-bf7d-492f-ba13-8252f564a16b req-109d4b61-b71e-44db-a429-5ed89a63446a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0887728
Jun 01 12:40:36.416799 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-17542cdb-bf7d-492f-ba13-8252f564a16b req-501494d1-1b05-468d-9af8-2007ef40e45b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383406
Jun 01 12:40:36.827707 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e2f59a4-696e-4df8-87f4-4557bfc53469 req-a675ce66-0452-4f78-a352-df2a10148703 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:36.829186 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2e2f59a4-696e-4df8-87f4-4557bfc53469 req-a675ce66-0452-4f78-a352-df2a10148703 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0808291
Jun 01 12:40:36.878139 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2e2f59a4-696e-4df8-87f4-4557bfc53469 req-281950d5-4c9a-43ff-a4ea-92a60ac20037 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/security-groups?id=b4540638-fbb0-447a-9b8e-046c38d5174a&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432997
Jun 01 12:40:37.464210 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-5cd2515e-2622-4b74-9280-f9e3f02a3f15 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:37.465836 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-5cd2515e-2622-4b74-9280-f9e3f02a3f15 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.95 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 945 time: 0.0830214
Jun 01 12:40:37.606073 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Deleting port d93addc7-07f1-4d9e-8775-05a3301e8f0e {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:37.606412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:37.611743 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe63ab0-06fb-4a6e-93e8-5c60b70dfa3d req-8aebe62a-36b1-45c5-8cf9-4465f2e4400f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:37.613245 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ebe63ab0-06fb-4a6e-93e8-5c60b70dfa3d req-8aebe62a-36b1-45c5-8cf9-4465f2e4400f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0826495
Jun 01 12:40:37.656983 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ebe63ab0-06fb-4a6e-93e8-5c60b70dfa3d req-7ffae53b-c1a2-4dab-a843-2f6862e77c37 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0380991
Jun 01 12:40:37.740300 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] For port d93addc7-07f1-4d9e-8775-05a3301e8f0e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d93addc7-07f1-4d9e-8775-05a3301e8f0e,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:37.740677 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:37.864182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Calling delete_port for d93addc7-07f1-4d9e-8775-05a3301e8f0e owned by compute:nova {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:38.014623 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-d88010c3-34a2-4d53-ac26-af7fe4bb8f5e service neutron] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1116667
Jun 01 12:40:38.034846 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:38.040902 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-04db9dc5-51d8-47b5-8131-17278f1cc36f tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:38.047868 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d93addc7-07f1-4d9e-8775-05a3301e8f0e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:40:38.073727 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f52d0d8e-7f25-496a-aa85-3a91669e3849 req-84825001-7521-40a9-9c51-10084b3acfff tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.81 "GET /v2.0/ports?device_id=fd896d4f-6dd8-4949-93b9-acbba04346f8 HTTP/1.1" status: 200  len: 210 time: 0.0844815
Jun 01 12:40:38.094205 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Pushing event deleted for resources: {'Port': ['ID=d93addc7-07f1-4d9e-8775-05a3301e8f0e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:38.105359 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:38.119664 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56d80dc-4d26-44aa-8a0c-82a68e9bc9ab req-28f1ec38-fc1f-435a-b8a6-9f5ecd9d78a1 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:38.121505 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a56d80dc-4d26-44aa-8a0c-82a68e9bc9ab req-28f1ec38-fc1f-435a-b8a6-9f5ecd9d78a1 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.1056409
Jun 01 12:40:38.176803 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a56d80dc-4d26-44aa-8a0c-82a68e9bc9ab req-888a11fe-90ea-4318-956e-dc896272764b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0490820
Jun 01 12:40:38.190215 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] No DVR routers for this DVR port d93addc7-07f1-4d9e-8775-05a3301e8f0e on host hv-cinder-79351 {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:40:38.203580 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:38.206485 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'name': 'network-vif-deleted', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e'}] {{(pid=91978) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:38.208790 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08332f069cdff5b13479b061d6bbe376049db186f7bff4c04e61a4b86035db55" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b5f79693-9d0c-4ac8-b927-0f9fba4d1d2f" -d '{"events": [{"server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "name": "network-vif-deleted", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e"}]}' {{(pid=91978) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:38.223407 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-1b1b2aa9-d841-460f-a893-9cfe99d34b0a req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] 10.222.0.95 "DELETE /v2.0/ports/d93addc7-07f1-4d9e-8775-05a3301e8f0e HTTP/1.1" status: 204  len: 173 time: 0.7507768
Jun 01 12:40:38.240280 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device db567b77-bbc1-4e8f-95eb-46817c3ec9d6 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:38.257792 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb9c210b-be36-4b38-b33d-78e035c4733f x-openstack-request-id: req-bb9c210b-be36-4b38-b33d-78e035c4733f {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:38.258128 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd896d4f-6dd8-4949-93b9-acbba04346f8", "name": "network-vif-deleted", "tag": "d93addc7-07f1-4d9e-8775-05a3301e8f0e", "status": "completed", "code": 200}]} {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:38.258417 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-bb9c210b-be36-4b38-b33d-78e035c4733f {{(pid=91978) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:38.258845 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd896d4f-6dd8-4949-93b9-acbba04346f8', 'name': 'network-vif-deleted', 'tag': 'd93addc7-07f1-4d9e-8775-05a3301e8f0e', 'status': 'completed', 'code': 200}
Jun 01 12:40:38.364115 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:38.392730 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:38.394853 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf02232b-2df4-448c-8cce-728e5f9ce398" -d '{"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-unplugged", "status": "completed", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:38.402650 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:38.406899 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:38.407729 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d93addc7-07f1-4d9e-8775-05a3301e8f0e no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:38.482536 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74948530-19db-4df2-b831-2a5b685b0fdd x-openstack-request-id: req-74948530-19db-4df2-b831-2a5b685b0fdd {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:38.483046 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-unplugged", "status": "failed", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6", "code": 422}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:38.483312 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-74948530-19db-4df2-b831-2a5b685b0fdd {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:38.483752 dv-cinder-793515-2-iscsi neutron-server[91980]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'code': 422} returned with failed status
Jun 01 12:40:38.484678 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:38.531185 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: d93addc7-07f1-4d9e-8775-05a3301e8f0e {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:38.531544 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d93addc7-07f1-4d9e-8775-05a3301e8f0e not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:38.559163 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=6']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:38.562442 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:38.877604 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:40:39.376667 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27ce0fc-bbc2-4c73-bc3c-acf4d28f4252 req-c5beabd5-5907-45e7-9e88-58bb48058a9e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:39.378208 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e27ce0fc-bbc2-4c73-bc3c-acf4d28f4252 req-c5beabd5-5907-45e7-9e88-58bb48058a9e tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.0859652
Jun 01 12:40:39.430542 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e27ce0fc-bbc2-4c73-bc3c-acf4d28f4252 req-f42d9298-9d56-4b4a-a1f6-36a2e74b52fc tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0459545
Jun 01 12:40:39.699105 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34192) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:39.844347 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-4648fb7c-8f8d-4b78-8901-66641855ce9a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:40.352141 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:40.617344 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b697768-3395-4905-98e3-40a25a80a349 req-bf2431f7-b06b-4380-b93b-c694630306cb tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:40.619430 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5b697768-3395-4905-98e3-40a25a80a349 req-bf2431f7-b06b-4380-b93b-c694630306cb tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.0798197
Jun 01 12:40:40.755097 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5b697768-3395-4905-98e3-40a25a80a349 req-17e743ca-6193-4f7a-9b73-f672c63a1d3f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1297641
Jun 01 12:40:40.777998 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Deleting port 1fb85678-c033-49a9-9d95-b4981b00a7a1 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:40.778496 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:40.899140 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] For port 1fb85678-c033-49a9-9d95-b4981b00a7a1, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=1fb85678-c033-49a9-9d95-b4981b00a7a1,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:40.899393 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:41.023414 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Calling delete_port for 1fb85678-c033-49a9-9d95-b4981b00a7a1 owned by network:router_interface {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:41.306581 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:41.310716 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-eb06bbda-5a14-401b-83c7-9e00c31bcf0f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:41.357293 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Pushing event deleted for resources: {'Port': ['ID=1fb85678-c033-49a9-9d95-b4981b00a7a1,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:41.360771 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:41.757895 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-384f3e7e-e7ca-4f0a-b7a0-9794e459923a service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.3696361
Jun 01 12:40:41.843224 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:42.101240 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:42.113517 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-16cb6826-3470-4d9e-8f4d-eb43bbff5302 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:42.115140 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-16cb6826-3470-4d9e-8f4d-eb43bbff5302 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 1099 time: 0.3241642
Jun 01 12:40:42.151791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3395c49-bccc-49bc-9ea4-1c68c493f52f req-2874423b-15d7-4e94-8cdb-4b6178575d55 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:42.153354 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a3395c49-bccc-49bc-9ea4-1c68c493f52f req-2874423b-15d7-4e94-8cdb-4b6178575d55 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.2843671
Jun 01 12:40:42.316266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:42.429836 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a3395c49-bccc-49bc-9ea4-1c68c493f52f req-7faf190f-e530-4e0c-b03e-2de89a33d502 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2541325
Jun 01 12:40:42.479410 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-c417e85e-c2aa-426e-953d-c9e2fff542ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:42.480906 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-c417e85e-c2aa-426e-953d-c9e2fff542ed service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.3251598
Jun 01 12:40:42.495450 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Router 43f207c7-1198-400a-9361-6f9c7b4a3880 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:40:42.674815 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-090f75fb-950d-4442-9794-a655cba78e5b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:42.681231 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-8837d469-c377-44a0-ba34-0c2faf8294c8 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 200  len: 1001 time: 0.1846371
Jun 01 12:40:42.819594 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-2afa8784-65b7-4bd0-a3db-2d2c14018803 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:42.820959 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-2afa8784-65b7-4bd0-a3db-2d2c14018803 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0891201
Jun 01 12:40:42.822609 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:40:42.833256 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] Sync routers for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:40:42.843388 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:42.843996 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25bce400>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:42.878565 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] 10.222.0.81 "PUT /v2.0/routers/43f207c7-1198-400a-9361-6f9c7b4a3880/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.1783466
Jun 01 12:40:42.881076 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34216) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:43.034623 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:43.177416 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-f8566bfe-1bbd-470f-829a-0e7fd96dc3f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:43.178894 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-f8566bfe-1bbd-470f-829a-0e7fd96dc3f6 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3496280
Jun 01 12:40:43.219966 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks [] for router, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:43.270908 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-5fdf3a3b-1ae7-4f0f-8571-6c7012987319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:43.272534 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-5fdf3a3b-1ae7-4f0f-8571-6c7012987319 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf&tenant_id=a4d9bab00fe345e0b899bc42ea4416e0 HTTP/1.1" status: 200  len: 1096 time: 0.0714543
Jun 01 12:40:43.327360 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25bce400>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:40:41Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:43.331336 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] Checking router: 43f207c7-1198-400a-9361-6f9c7b4a3880 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:40:43.340912 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] Routers {'43f207c7-1198-400a-9361-6f9c7b4a3880'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:43.341768 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25bce400>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['43f207c7-1198-400a-9361-6f9c7b4a3880'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:43.374915 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-1de76733-83c8-4439-878e-d7759240904a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:43.376592 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-1de76733-83c8-4439-878e-d7759240904a service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1096 time: 0.0812323
Jun 01 12:40:43.513313 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:43.527064 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-d192dd9a-841a-4da2-b6eb-b0611cc9d017 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3376634
Jun 01 12:40:43.540523 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] Set router 43f207c7-1198-400a-9361-6f9c7b4a3880 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:43.609868 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-920172e0-2d94-4f9e-92d4-ec2f1e0ad0a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:43.611222 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-920172e0-2d94-4f9e-92d4-ec2f1e0ad0a7 service neutron] 10.222.0.95 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 907 time: 0.2268426
Jun 01 12:40:43.734314 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8a05c8a8-7cf8-4aa0-97bd-660e4de67f6c req-84a9c712-c522-4ec3-8191-26a63c71170a service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1672709
Jun 01 12:40:43.735880 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Deleting port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:43.736210 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-af0596f7-2d12-4692-8b8a-4d168607addb service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 999 time: 0.1127760
Jun 01 12:40:43.736388 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:43.792044 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d338868-e7d4-490b-9db2-b226597384b8 req-7ecb082d-67cc-4f02-a224-67c1243f1f96 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:43.793621 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d338868-e7d4-490b-9db2-b226597384b8 req-7ecb082d-67cc-4f02-a224-67c1243f1f96 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.2376523
Jun 01 12:40:43.850873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-e6aa7870-4168-428b-86e5-24f29dbeb5b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:43.852318 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-e6aa7870-4168-428b-86e5-24f29dbeb5b9 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 200  len: 845 time: 0.1069217
Jun 01 12:40:43.858828 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d338868-e7d4-490b-9db2-b226597384b8 req-aedfe88c-58b2-4375-861b-9488b81b1ba7 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0586615
Jun 01 12:40:43.898810 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:43.923520 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25bce400>, [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:40:41Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:43.931177 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6b2e59c-8e1d-4549-bdce-2fb722dd364f None None] The sync data for ids ['43f207c7-1198-400a-9361-6f9c7b4a3880'] in dv-cinder-793515-2-iscsi is: [{'id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'name': 'tempest-TestMinimumBasicScenario-1765038833-router', 'tenant_id': 'c9f26a8407554421b6fc3162658b8a00', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:01Z', 'updated_at': '2021-06-01T12:40:41Z', 'revision_number': 5, 'project_id': 'c9f26a8407554421b6fc3162658b8a00', 'gw_port': {'id': '5bf3a8a5-384d-48b6-8f8f-e7dae6300494', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:06:75:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '43f207c7-1198-400a-9361-6f9c7b4a3880', 'device_owner': 'network:router_gateway', 'standard_attr_id': 511, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:02Z', 'updated_at': '2021-06-01T12:38:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:40:43.938023 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] For port 5bf3a8a5-384d-48b6-8f8f-e7dae6300494, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:43.938498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:43.995154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-2730e86b-6b7b-4d98-b1e7-491c0b801a30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:43.996738 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-2730e86b-6b7b-4d98-b1e7-491c0b801a30 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=8c58f5e9-2554-475d-a254-a02b35fda51b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1304538
Jun 01 12:40:44.077938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Calling delete_port for 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 owned by network:router_gateway {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:44.185873 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-429730ce-5bb2-4985-8055-41027ba24ad9 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1517205
Jun 01 12:40:44.259285 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:44.264414 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:44.316587 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1fb85678-c033-49a9-9d95-b4981b00a7a1 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:44.321647 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Pushing event deleted for resources: {'Port': ['ID=5bf3a8a5-384d-48b6-8f8f-e7dae6300494,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:44.325675 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:44.372455 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 1fb85678-c033-49a9-9d95-b4981b00a7a1 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:44.373018 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1fb85678-c033-49a9-9d95-b4981b00a7a1 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:44.434466 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c60e045c-4b1d-47ef-841a-aba64ba9a931 req-3733e145-0e26-436b-9caa-31baf71c2148 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2163866
Jun 01 12:40:44.469985 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:44.656225 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:44.658383 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:44.681098 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:44.681801 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 43f207c7-1198-400a-9361-6f9c7b4a3880 {{(pid=91978) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:40:44.700176 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:44.701346 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] 10.222.0.81 "DELETE /v2.0/routers/43f207c7-1198-400a-9361-6f9c7b4a3880 HTTP/1.1" status: 204  len: 168 time: 1.8193932
Jun 01 12:40:44.703789 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34234) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:44.766695 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Deleting subnet 6cb03821-94fa-4f9d-a846-04af6674699b {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:40:44.768143 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:44.927540 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.048656 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.062273 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3121d79f-8048-4416-ac0e-f94860b1e844 req-ef198885-9968-42f3-a387-c34814bba490 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:45.063758 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3121d79f-8048-4416-ac0e-f94860b1e844 req-ef198885-9968-42f3-a387-c34814bba490 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.0822096
Jun 01 12:40:45.122321 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3121d79f-8048-4416-ac0e-f94860b1e844 req-3de442b5-1dd3-443d-8e45-62b6a8d88522 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0521863
Jun 01 12:40:45.319317 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.324497 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-111c37c9-3721-4828-85db-543d0cb4d3ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:45.363906 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.366954 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6cb03821-94fa-4f9d-a846-04af6674699b,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:45.368657 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2370b078-f8e0-4712-93b7-854b9979fadc None None] Network a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:40:45.369298 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:45.373590 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-23bdcd4b-e05f-4e31-9a60-5639e2856393 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/6cb03821-94fa-4f9d-a846-04af6674699b HTTP/1.1" status: 204  len: 168 time: 0.6688740
Jun 01 12:40:45.375985 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34242) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:45.475696 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.482666 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.560674 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Deleting port 2eeb3d6f-6070-419d-813c-808b79e5aab5 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:45.561070 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.644853 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] DHCP port deletion for a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:40:45.667907 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] For port 2eeb3d6f-6070-419d-813c-808b79e5aab5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=2eeb3d6f-6070-419d-813c-808b79e5aab5,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:45.668259 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.739493 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Deleting port 2eeb3d6f-6070-419d-813c-808b79e5aab5 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:45.739790 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.791180 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Calling delete_port for 2eeb3d6f-6070-419d-813c-808b79e5aab5 owned by network:dhcp {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:45.837405 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.840809 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] For port 2eeb3d6f-6070-419d-813c-808b79e5aab5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=2eeb3d6f-6070-419d-813c-808b79e5aab5,segment=NetworkSegment(c18cba8e-a441-49ac-8933-33a840319416),segment_id=c18cba8e-a441-49ac-8933-33a840319416)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:45.841361 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:45.842602 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9cd7c206-bab6-41d7-a09e-a92c88df2ae1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:45.889313 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=2eeb3d6f-6070-419d-813c-808b79e5aab5,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:45.891016 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] No DVR routers for this DVR port 2eeb3d6f-6070-419d-813c-808b79e5aab5 on host dv-cinder-793515-2-iscsi {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:40:45.892498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:45.963801 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Calling delete_port for 2eeb3d6f-6070-419d-813c-808b79e5aab5 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:46.007198 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:46.020225 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a243fbd00>,) {'filters': {'network_id': ['a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:46.032186 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a243fbd00>, 'c18cba8e-a441-49ac-8933-33a840319416') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:46.032476 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a243fbd00>, 'c18cba8e-a441-49ac-8933-33a840319416') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:46.044153 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:46.059939 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:46.065946 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Releasing vlan 758 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:40:46.066318 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:40:46.079864 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:40:46.087280 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:46.091525 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-29aafb66-e32b-46d2-bf21-070a445474ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:46.143051 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Pushing event deleted for resources: {'Port': ['ID=2eeb3d6f-6070-419d-813c-808b79e5aab5,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:46.148883 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:46.150686 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] No DVR routers for this DVR port 2eeb3d6f-6070-419d-813c-808b79e5aab5 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:40:46.166871 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:46.172178 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:46.178182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-29bb34e2-81b5-4229-ba60-f94ec096584b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:46.180358 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:46.200028 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Pushing event deleted for resources: {'Network': ['ID=a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:46.204390 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:46.207914 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2f5971c2-415f-4272-99f5-b1818e3f03e9 admin admin] 10.222.0.81 "DELETE /v2.0/networks/a2255cd0-2ed2-41a8-a911-28f4d6d0b1c1 HTTP/1.1" status: 204  len: 168 time: 0.8309860
Jun 01 12:40:46.210906 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34250) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:46.220372 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:46.220775 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5bf3a8a5-384d-48b6-8f8f-e7dae6300494 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:46.221406 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 2eeb3d6f-6070-419d-813c-808b79e5aab5 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:46.256647 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 2eeb3d6f-6070-419d-813c-808b79e5aab5 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:46.257004 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 2eeb3d6f-6070-419d-813c-808b79e5aab5 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:46.552148 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4bc1a9-fbc6-410a-bfdf-c607961c1282 req-1acfa98a-a879-490c-ade3-944fa9b9a688 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:46.553631 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6c4bc1a9-fbc6-410a-bfdf-c607961c1282 req-1acfa98a-a879-490c-ade3-944fa9b9a688 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.2823813
Jun 01 12:40:46.720154 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6c4bc1a9-fbc6-410a-bfdf-c607961c1282 req-a6e9300e-e2fd-45bd-b074-1d5dece84f0a tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1168077
Jun 01 12:40:46.950195 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:47.354173 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Deleting port 04679eb3-3be3-4918-9f07-899ce27566e8 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:47.354861 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:47.474003 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] For port 04679eb3-3be3-4918-9f07-899ce27566e8, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=04679eb3-3be3-4918-9f07-899ce27566e8,segment=NetworkSegment(d157676f-795c-471e-8e61-958dc1e2cb97),segment_id=d157676f-795c-471e-8e61-958dc1e2cb97)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:47.474350 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:47.593372 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Calling delete_port for 04679eb3-3be3-4918-9f07-899ce27566e8 owned by network:router_interface {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:47.738861 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:47.743292 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e547d3f8-b6c7-4cef-926b-5523a9d1fde7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:47.787174 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Pushing event deleted for resources: {'Port': ['ID=04679eb3-3be3-4918-9f07-899ce27566e8,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:47.789454 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:47.916370 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a3a5e2-2d9f-405b-afb1-ecf316972f02 req-3b2ce3a9-49d6-4ff2-9e1f-b9c2be354e46 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:47.918689 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-42a3a5e2-2d9f-405b-afb1-ecf316972f02 req-3b2ce3a9-49d6-4ff2-9e1f-b9c2be354e46 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.0902188
Jun 01 12:40:47.969081 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-42a3a5e2-2d9f-405b-afb1-ecf316972f02 req-29a04a74-993c-46c8-a9f4-93796be8da9f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0443158
Jun 01 12:40:48.173998 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:48.526109 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:40:48.698995 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:40:48.707110 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] Sync routers for ids ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:40:48.716740 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a9f773eb-a3b3-4047-84b9-10b91217b903 admin admin] 10.222.0.81 "PUT /v2.0/routers/29fa0bf2-324b-44b6-bfd3-c2d0020158d5/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5024886
Jun 01 12:40:48.716971 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34262) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:48.717468 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] Routers {'29fa0bf2-324b-44b6-bfd3-c2d0020158d5'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:48.718082 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2693bca0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:48.895241 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] Set router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:48.896662 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks [] for router, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:49.072865 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:49.179356 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2693bca0>, [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131'}], 'enable_snat': True}, 'gw_port_id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:40:47Z', 'revision_number': 5, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port': {'id': '7b67088d-5113-4748-859f-22ad3e8702e9', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:de:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 539, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:15Z', 'updated_at': '2021-06-01T12:38:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:49.183902 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] Checking router: 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:40:49.192468 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] Routers {'29fa0bf2-324b-44b6-bfd3-c2d0020158d5'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:40:49.193176 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a2693bca0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:49.209437 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5709aa-94a3-43f8-97e1-233e8599092d req-48653b28-42aa-4523-b6c5-84c30aa8e0b4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:49.210923 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5a5709aa-94a3-43f8-97e1-233e8599092d req-48653b28-42aa-4523-b6c5-84c30aa8e0b4 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.1339889
Jun 01 12:40:49.212846 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Deleting port 7b67088d-5113-4748-859f-22ad3e8702e9 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:49.212985 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:49.330116 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5a5709aa-94a3-43f8-97e1-233e8599092d req-c1f3e364-fd26-4cff-a505-f8a77d212f49 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1048429
Jun 01 12:40:49.372612 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] Set router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 gateway port host: None {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:40:49.388267 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] For port 7b67088d-5113-4748-859f-22ad3e8702e9, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=7b67088d-5113-4748-859f-22ad3e8702e9,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:49.388655 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:49.477663 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a2693bca0>, [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:40:49Z', 'revision_number': 6, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port_host': None}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:49.482718 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98389246-21b3-46cb-a10e-dcf89b3ba454 None None] The sync data for ids ['29fa0bf2-324b-44b6-bfd3-c2d0020158d5'] in dv-cinder-793515-2-iscsi is: [{'id': '29fa0bf2-324b-44b6-bfd3-c2d0020158d5', 'name': 'tempest-TestMinimumBasicScenario-2044626514-router', 'tenant_id': 'd5d4ae84f265473eb98954af0f01a963', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:14Z', 'updated_at': '2021-06-01T12:40:49Z', 'revision_number': 6, 'project_id': 'd5d4ae84f265473eb98954af0f01a963', 'gw_port_host': None}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:40:49.622878 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Calling delete_port for 7b67088d-5113-4748-859f-22ad3e8702e9 owned by network:router_gateway {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:49.758789 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:49.762661 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d1d85bb6-979a-459d-886f-7be30aaad81b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:49.804671 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Pushing event deleted for resources: {'Port': ['ID=7b67088d-5113-4748-859f-22ad3e8702e9,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:49.808234 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:49.903235 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.077058 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.079242 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.101436 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.101835 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 29fa0bf2-324b-44b6-bfd3-c2d0020158d5 {{(pid=91978) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:40:50.113780 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.114901 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b2870abd-5c29-473c-8275-70da24a9b249 admin admin] 10.222.0.81 "DELETE /v2.0/routers/29fa0bf2-324b-44b6-bfd3-c2d0020158d5 HTTP/1.1" status: 204  len: 168 time: 1.3970397
Jun 01 12:40:50.117399 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34272) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:50.175998 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Deleting subnet af328333-62ea-4d73-aa26-e559eeb285f9 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:40:50.178850 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.236144 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.267279 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 7b67088d-5113-4748-859f-22ad3e8702e9 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:50.301752 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 7b67088d-5113-4748-859f-22ad3e8702e9 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:50.302108 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 7b67088d-5113-4748-859f-22ad3e8702e9 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:50.302542 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 04679eb3-3be3-4918-9f07-899ce27566e8 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:50.317409 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.336734 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 04679eb3-3be3-4918-9f07-899ce27566e8 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:50.337007 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 04679eb3-3be3-4918-9f07-899ce27566e8 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:50.530393 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7941d0-730e-4cbe-9c5f-7c172cdb9756 req-7399e388-99e2-4da9-b13e-453320176604 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:50.531849 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7b7941d0-730e-4cbe-9c5f-7c172cdb9756 req-7399e388-99e2-4da9-b13e-453320176604 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.0916884
Jun 01 12:40:50.578263 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-7b7941d0-730e-4cbe-9c5f-7c172cdb9756 req-5512bf26-63b8-4437-856d-3d9ed1117fd0 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404465
Jun 01 12:40:50.589784 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.596875 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:50.636935 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=af328333-62ea-4d73-aa26-e559eeb285f9,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:50.639579 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:50.641941 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.647712 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-384d645b-6c34-48ea-89ef-5e4beab787cd None None] Network 0c0b6436-f8c8-4324-8b99-db3df38ef70c requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:40:50.649407 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-9ed026fb-588c-4cb8-b5c7-626144e615a3 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/af328333-62ea-4d73-aa26-e559eeb285f9 HTTP/1.1" status: 204  len: 168 time: 0.5310547
Jun 01 12:40:50.652254 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34278) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:50.758522 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.831226 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Deleting port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:50.831567 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.896089 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] DHCP port deletion for 0c0b6436-f8c8-4324-8b99-db3df38ef70c request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:40:50.939791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] For port 5b0a906d-d514-4e3a-8cab-b34537beb9a5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=5b0a906d-d514-4e3a-8cab-b34537beb9a5,segment=NetworkSegment(d157676f-795c-471e-8e61-958dc1e2cb97),segment_id=d157676f-795c-471e-8e61-958dc1e2cb97)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:50.940139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:50.962062 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Deleting port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:50.962930 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.069782 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] For port 5b0a906d-d514-4e3a-8cab-b34537beb9a5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=5b0a906d-d514-4e3a-8cab-b34537beb9a5,segment=NetworkSegment(d157676f-795c-471e-8e61-958dc1e2cb97),segment_id=d157676f-795c-471e-8e61-958dc1e2cb97)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:51.070328 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.169135 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Calling delete_port for 5b0a906d-d514-4e3a-8cab-b34537beb9a5 owned by network:dhcp {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:51.193672 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Calling delete_port for 5b0a906d-d514-4e3a-8cab-b34537beb9a5 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:40:51.216476 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.221532 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:51.239785 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.243322 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:51.266608 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Pushing event deleted for resources: {'Port': ['ID=5b0a906d-d514-4e3a-8cab-b34537beb9a5,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:51.268465 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] No DVR routers for this DVR port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 on host dv-cinder-793515-2-iscsi {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:40:51.269958 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:51.290285 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Pushing event deleted for resources: {'Port': ['ID=5b0a906d-d514-4e3a-8cab-b34537beb9a5,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:51.292100 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] No DVR routers for this DVR port 5b0a906d-d514-4e3a-8cab-b34537beb9a5 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:40:51.293479 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:51.388640 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.402346 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a26758d00>,) {'filters': {'network_id': ['0c0b6436-f8c8-4324-8b99-db3df38ef70c']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:51.414343 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a26758d00>, 'd157676f-795c-471e-8e61-958dc1e2cb97') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:51.414639 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a26758d00>, 'd157676f-795c-471e-8e61-958dc1e2cb97') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:40:51.425945 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.443106 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.451419 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Releasing vlan 750 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:40:51.451800 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:40:51.465497 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:40:51.540612 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.544083 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:51.557238 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.566843 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Pushing event deleted for resources: {'Network': ['ID=0c0b6436-f8c8-4324-8b99-db3df38ef70c,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:51.571185 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:51.575054 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] 10.222.0.81 "DELETE /v2.0/networks/0c0b6436-f8c8-4324-8b99-db3df38ef70c HTTP/1.1" status: 204  len: 168 time: 0.9218366
Jun 01 12:40:51.750382 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34288) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:51.779966 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3467d705-ecd5-42ec-9897-e4c7c10bdcbb req-c1e58adb-4687-4e32-86db-e66c1f4a6407 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:51.781471 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3467d705-ecd5-42ec-9897-e4c7c10bdcbb req-c1e58adb-4687-4e32-86db-e66c1f4a6407 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 943 time: 0.0907607
Jun 01 12:40:51.800578 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c745c1f9-b32d-4f95-9862-eada9e25fe09 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c9f26a8407554421b6fc3162658b8a00&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0475698
Jun 01 12:40:51.801640 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34292) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:51.827769 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3467d705-ecd5-42ec-9897-e4c7c10bdcbb req-9e53d1ee-9138-4163-92ce-e0f7a1d2cb05 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402505
Jun 01 12:40:51.860806 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-10cbc3b4-1e0c-459c-bda3-91060f471289 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.887070 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-10cbc3b4-1e0c-459c-bda3-91060f471289 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.937796 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-10cbc3b4-1e0c-459c-bda3-91060f471289 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.942849 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a21aaf9c-0f74-489a-a946-084f03531557 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:51.958933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10cbc3b4-1e0c-459c-bda3-91060f471289 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b4540638-fbb0-447a-9b8e-046c38d5174a,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:51.962163 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-10cbc3b4-1e0c-459c-bda3-91060f471289 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:51.970399 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-10cbc3b4-1e0c-459c-bda3-91060f471289 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:51.971495 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-10cbc3b4-1e0c-459c-bda3-91060f471289 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b4540638-fbb0-447a-9b8e-046c38d5174a HTTP/1.1" status: 204  len: 168 time: 0.1689703
Jun 01 12:40:52.163678 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5b0a906d-d514-4e3a-8cab-b34537beb9a5 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:40:52.200057 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 5b0a906d-d514-4e3a-8cab-b34537beb9a5 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:40:52.200409 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 5b0a906d-d514-4e3a-8cab-b34537beb9a5 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:40:52.311930 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device db567b77-bbc1-4e8f-95eb-46817c3ec9d6 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:40:52.349929 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34308) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:52.402857 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-f7dc1db3-17b2-4e3d-ab61-97295f226632 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d5d4ae84f265473eb98954af0f01a963&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0510769
Jun 01 12:40:52.405184 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34312) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:40:52.462754 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2dec3ff4-c3c6-4afe-a3af-02e65e0638e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:52.482126 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:52.488324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2dec3ff4-c3c6-4afe-a3af-02e65e0638e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:52.495796 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'port_id': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'mac_address': 'fa:16:3e:1a:fe:d7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 792, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:40:52.543383 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2dec3ff4-c3c6-4afe-a3af-02e65e0638e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:52.547998 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-21170c3a-a812-4858-a594-0d05b1869e5e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:52.556317 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:52.559222 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dec3ff4-c3c6-4afe-a3af-02e65e0638e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=217cba42-772c-4701-889f-404e8b8ad8f1,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:52.566530 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2dec3ff4-c3c6-4afe-a3af-02e65e0638e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:52.572708 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2dec3ff4-c3c6-4afe-a3af-02e65e0638e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:52.573818 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2dec3ff4-c3c6-4afe-a3af-02e65e0638e7 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/217cba42-772c-4701-889f-404e8b8ad8f1 HTTP/1.1" status: 204  len: 168 time: 0.1676564
Jun 01 12:40:52.583958 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id db567b77-bbc1-4e8f-95eb-46817c3ec9d6 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:40:52.601236 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:52.605567 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:52.607505 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:52.674662 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=7']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:52.677857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:52.882964 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['db567b77-bbc1-4e8f-95eb-46817c3ec9d6'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:40:53.064925 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bbaf217-94e5-457b-8ee3-aec26e8b0cb4 req-7038c430-2a99-4903-b83c-ee26a68708bf tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:53.066527 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2bbaf217-94e5-457b-8ee3-aec26e8b0cb4 req-7038c430-2a99-4903-b83c-ee26a68708bf tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 944 time: 0.1221733
Jun 01 12:40:53.124933 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2bbaf217-94e5-457b-8ee3-aec26e8b0cb4 req-047dca53-8503-41b2-b75e-1fdbfefa1562 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0503178
Jun 01 12:40:54.311757 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c30eb4c-85e3-48a5-bf1e-49b3cadec3f6 req-40f94ba1-3470-4b1c-a818-dc9977ddd5b0 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:54.313221 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3c30eb4c-85e3-48a5-bf1e-49b3cadec3f6 req-40f94ba1-3470-4b1c-a818-dc9977ddd5b0 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 944 time: 0.0791948
Jun 01 12:40:54.325948 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device db567b77-bbc1-4e8f-95eb-46817c3ec9d6 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:40:54.359646 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3c30eb4c-85e3-48a5-bf1e-49b3cadec3f6 req-34980b08-4559-42fe-8527-6a9f18439a20 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404167
Jun 01 12:40:54.394718 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:40:54.395095 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:54.514150 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:54.541176 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:40:54.543697 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8157f817-c766-44ae-bfe1-9c23e859a64d" -d '{"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-plugged", "status": "completed", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:40:54.551728 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:54.555762 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:54.557936 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:40:54.593764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:40:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2448342a-d8fb-42ea-bae6-a1b9b227c2ee x-openstack-request-id: req-2448342a-d8fb-42ea-bae6-a1b9b227c2ee {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:40:54.593764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-plugged", "status": "completed", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:40:54.594039 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-2448342a-d8fb-42ea-bae6-a1b9b227c2ee {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:40:54.594356 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'code': 200}
Jun 01 12:40:54.626380 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=8']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:40:54.629280 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:40:54.899077 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7ff149-c788-402c-b100-1bfe4e72fd14 req-f079610a-c612-4a05-b8c6-205196b6cd1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:54.901121 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2c7ff149-c788-402c-b100-1bfe4e72fd14 req-f079610a-c612-4a05-b8c6-205196b6cd1b service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1098 time: 0.0730009
Jun 01 12:40:54.942720 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2c7ff149-c788-402c-b100-1bfe4e72fd14 req-a0cdf222-60de-48f0-8003-78f1a9ab6eb9 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0333695
Jun 01 12:40:55.547757 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adfec456-d0c5-4fc9-98df-246df74e365c req-19e350a6-e1a2-44cb-b032-b811237e4e60 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:55.549258 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-adfec456-d0c5-4fc9-98df-246df74e365c req-19e350a6-e1a2-44cb-b032-b811237e4e60 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0802429
Jun 01 12:40:55.601382 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-adfec456-d0c5-4fc9-98df-246df74e365c req-c1c25bac-70c1-48d1-b182-308bd8bd6d8c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0425017
Jun 01 12:40:56.785819 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-745f15a2-4acb-4bc8-b3fa-ace8c34fc691 req-4b7b8f55-08f7-43b3-9546-151a3da8265f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:56.787268 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-745f15a2-4acb-4bc8-b3fa-ace8c34fc691 req-4b7b8f55-08f7-43b3-9546-151a3da8265f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.0797830
Jun 01 12:40:56.843776 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-745f15a2-4acb-4bc8-b3fa-ace8c34fc691 req-94100911-c319-4844-977e-2cd8d69b7214 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0503466
Jun 01 12:40:57.655683 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4252ea2-3572-45d3-be41-2a82ec449571 req-c330fd8b-268b-4b5e-9eb4-9bcf6c70cadd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:57.657168 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e4252ea2-3572-45d3-be41-2a82ec449571 req-c330fd8b-268b-4b5e-9eb4-9bcf6c70cadd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 946 time: 0.0832236
Jun 01 12:40:57.701613 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e4252ea2-3572-45d3-be41-2a82ec449571 req-0b723f6a-6491-467d-9ad8-20ed641e5f0d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388587
Jun 01 12:40:58.892893 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b310b94-c6cb-4bd0-96d8-ef42fb43db30 req-c3aeea23-76ce-4f5e-afcd-4a037516c0bb tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:58.894380 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b310b94-c6cb-4bd0-96d8-ef42fb43db30 req-c3aeea23-76ce-4f5e-afcd-4a037516c0bb tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 946 time: 0.0873363
Jun 01 12:40:58.939888 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b310b94-c6cb-4bd0-96d8-ef42fb43db30 req-329492cc-add4-4f86-a5cc-d1871a4d96bd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400121
Jun 01 12:40:59.523379 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-8af7f9ee-196a-4e20-80fd-1508253993eb tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:40:59.524897 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-8af7f9ee-196a-4e20-80fd-1508253993eb tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 946 time: 0.1589468
Jun 01 12:40:59.659859 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Deleting port 77238847-8750-416f-81a1-a7943b9df7f6 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:40:59.660088 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:40:59.794933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] For port 77238847-8750-416f-81a1-a7943b9df7f6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=77238847-8750-416f-81a1-a7943b9df7f6,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:40:59.795275 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:00.144688 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:00.145203 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:00.145417 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Floating IP 0afcb26d-7fa1-4eb4-8fdc-c769751b6daf disassociated. External IP: 172.27.3.25, port: 77238847-8750-416f-81a1-a7943b9df7f6.
Jun 01 12:41:00.145756 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Calling delete_port for 77238847-8750-416f-81a1-a7943b9df7f6 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:00.183137 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d332195-9750-4b28-a54e-148221255acd req-82eee7b9-c0ce-418e-b687-4e4d6c1a4f3c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:00.184545 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d332195-9750-4b28-a54e-148221255acd req-82eee7b9-c0ce-418e-b687-4e4d6c1a4f3c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 946 time: 0.1306677
Jun 01 12:41:00.244628 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6d332195-9750-4b28-a54e-148221255acd req-9a21343b-f200-4c31-99ae-c3e51bfe261b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups?id=557c0853-95ed-46a5-89a8-65d51ab258d6&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0539241
Jun 01 12:41:00.314476 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:00.320138 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c499357b-8998-4213-8a1e-8858b420db50 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:00.364803 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event deleted for resources: {'Port': ['ID=77238847-8750-416f-81a1-a7943b9df7f6,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:00.367818 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:00.560663 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:41:00.743709 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:41:00.756212 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] Sync routers for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:41:00.767887 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:00.768699 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e93cd0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:00.870955 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] No DVR routers for this DVR port 77238847-8750-416f-81a1-a7943b9df7f6 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:41:00.878112 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:00.880605 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'name': 'network-vif-deleted', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:41:00.882870 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33107412-4ed6-413b-869c-694f8e9e365b" -d '{"events": [{"server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "name": "network-vif-deleted", "tag": "77238847-8750-416f-81a1-a7943b9df7f6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:41:00.904752 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b9ff4357-833f-4537-aaaf-7c1a2e2e8d40 req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.95 "DELETE /v2.0/ports/77238847-8750-416f-81a1-a7943b9df7f6 HTTP/1.1" status: 204  len: 173 time: 1.3734119
Jun 01 12:41:00.924773 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b53840-dabf-4881-8cd3-9910685d3b7e req-ebabcf19-870a-42aa-94b6-2cebd75d9987 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:00.926263 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d9b53840-dabf-4881-8cd3-9910685d3b7e req-ebabcf19-870a-42aa-94b6-2cebd75d9987 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 946 time: 0.1475210
Jun 01 12:41:00.931430 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:41:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a6bbef7-6be8-4004-8997-0f26e123cd22 x-openstack-request-id: req-0a6bbef7-6be8-4004-8997-0f26e123cd22 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:41:00.931756 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f028a5f-93ca-4a91-9257-6642ba6a4d9d", "name": "network-vif-deleted", "tag": "77238847-8750-416f-81a1-a7943b9df7f6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:41:00.932040 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-0a6bbef7-6be8-4004-8997-0f26e123cd22 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:41:00.932457 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f028a5f-93ca-4a91-9257-6642ba6a4d9d', 'name': 'network-vif-deleted', 'tag': '77238847-8750-416f-81a1-a7943b9df7f6', 'status': 'completed', 'code': 200}
Jun 01 12:41:00.975005 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:01.081467 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d9b53840-dabf-4881-8cd3-9910685d3b7e req-b7646ee3-1e5d-4b97-b9e2-869acb425069 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1399858
Jun 01 12:41:01.294841 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e93cd0>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:01.298715 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] Checking router: 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:41:01.307805 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:01.308384 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e93cd0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:01.415476 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4c905c27-29fd-433f-9688-18e868aaee71 req-11ec1dc6-dd70-4758-8ac8-4534334e48ee tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/ports?device_id=0f028a5f-93ca-4a91-9257-6642ba6a4d9d HTTP/1.1" status: 200  len: 210 time: 0.0440109
Jun 01 12:41:01.485311 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:01.819658 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e93cd0>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:01.824071 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58d76678-6a18-416d-8d67-8cba795b0281 None None] The sync data for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi is: [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:34:28Z', 'revision_number': 4, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'c41297e3-3729-4961-8e43-0de027b9fe9f', 'name': '', 'network_id': 'a43c69f6-c415-4ad5-8f5b-032eacaeb49e', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'mac_address': 'fa:16:3e:a7:64:dd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': '98e949e5-17bf-4e08-a5ea-232517784814', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:27Z', 'updated_at': '2021-06-01T12:34:43Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'subnets': [{'id': '98e949e5-17bf-4e08-a5ea-232517784814', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:41:02.132614 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e81b3670-aa64-4523-ad9d-48074fa2cf68 None None] New status for floating IP 0afcb26d-7fa1-4eb4-8fdc-c769751b6daf: DOWN {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:41:02.310673 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 77238847-8750-416f-81a1-a7943b9df7f6 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:41:02.318059 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d8a462-e7dd-4ef1-8b3e-73f53481595d req-325c5026-4072-401d-ae0d-89834b9bc514 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:02.322104 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c7d8a462-e7dd-4ef1-8b3e-73f53481595d req-325c5026-4072-401d-ae0d-89834b9bc514 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 946 time: 0.1246061
Jun 01 12:41:02.347648 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 77238847-8750-416f-81a1-a7943b9df7f6 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:41:02.347996 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 77238847-8750-416f-81a1-a7943b9df7f6 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:41:02.381043 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c7d8a462-e7dd-4ef1-8b3e-73f53481595d req-3fb890de-e22c-4a45-a92c-dfc7efb1fe75 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=3bc3847f-727c-4094-9173-73ca49a9dc5e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0495820
Jun 01 12:41:02.397389 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36101fe-eeb2-4826-905c-c334ecf042da req-ce057b93-efd8-4a5e-a405-ac94901ad129 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:02.398804 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a36101fe-eeb2-4826-905c-c334ecf042da req-ce057b93-efd8-4a5e-a405-ac94901ad129 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 946 time: 0.1335785
Jun 01 12:41:02.535012 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Deleting port dd8500c8-5962-4478-9c99-20281668d7c6 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:41:02.535345 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.543887 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34406) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:02.609024 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-612b9a34-bfd4-4ace-a05f-0c643693e7c6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.637478 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-612b9a34-bfd4-4ace-a05f-0c643693e7c6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.667474 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] For port dd8500c8-5962-4478-9c99-20281668d7c6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=dd8500c8-5962-4478-9c99-20281668d7c6,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:02.667920 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.695278 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-612b9a34-bfd4-4ace-a05f-0c643693e7c6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.699190 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2e90a667-47e4-476d-97b5-b6de4d8c8a96 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:02.714825 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-612b9a34-bfd4-4ace-a05f-0c643693e7c6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=557c0853-95ed-46a5-89a8-65d51ab258d6,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:02.717456 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-612b9a34-bfd4-4ace-a05f-0c643693e7c6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:02.730575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-612b9a34-bfd4-4ace-a05f-0c643693e7c6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.734360 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-612b9a34-bfd4-4ace-a05f-0c643693e7c6 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "DELETE /v2.0/security-groups/557c0853-95ed-46a5-89a8-65d51ab258d6 HTTP/1.1" status: 204  len: 168 time: 0.1867669
Jun 01 12:41:02.734600 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34410) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:02.751466 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.api.v2.resource [None req-5d1840dd-6c74-4f48-bcaa-4dadc1b22133 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] show failed (client error): The resource could not be found.
Jun 01 12:41:02.752452 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-5d1840dd-6c74-4f48-bcaa-4dadc1b22133 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "GET /v2.0/security-groups/557c0853-95ed-46a5-89a8-65d51ab258d6 HTTP/1.1" status: 404  len: 347 time: 0.0169032
Jun 01 12:41:02.755332 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34414) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:02.953036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.953323 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:02.953638 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Floating IP 28591775-0985-4a1c-ba11-27f697b7aac9 disassociated. External IP: 172.27.3.181, port: dd8500c8-5962-4478-9c99-20281668d7c6.
Jun 01 12:41:02.953976 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Calling delete_port for dd8500c8-5962-4478-9c99-20281668d7c6 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:02.972544 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Deleting port e75d92f0-df54-47a3-bba7-155e01b6faa6 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:41:02.973035 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.067420 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.073832 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8cba41bf-da95-44a8-86a0-9f269d9d6884 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:03.120846 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event deleted for resources: {'Port': ['ID=dd8500c8-5962-4478-9c99-20281668d7c6,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:03.123974 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:03.194136 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.194530 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.309425 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Router 7e176463-91d5-4735-ab79-0ea7c34c6767 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:41:03.314054 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Calling delete_port for e75d92f0-df54-47a3-bba7-155e01b6faa6 owned by network:floatingip {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:03.422293 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.427960 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:03.481041 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Pushing event deleted for resources: {'Port': ['ID=e75d92f0-df54-47a3-bba7-155e01b6faa6,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:03.489762 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:41:03.501077 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] Sync routers for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:41:03.510193 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:03.521280 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:03.524069 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25ec57f0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:03.570581 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-eec4ed18-6dfd-43ba-a1a2-eb87be138a9a req-c4c9be59-2060-4c76-a017-66147db950f2 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=402e7587-9ab6-41f7-b49c-31f4d6825d0c HTTP/1.1" status: 200  len: 210 time: 0.0592365
Jun 01 12:41:03.613276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] No DVR routers for this DVR port dd8500c8-5962-4478-9c99-20281668d7c6 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:41:03.616050 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.619003 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-deleted', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:41:03.621564 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0a7e5fc-167a-45a5-8afc-d222772eb4f5" -d '{"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-deleted", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:41:03.633828 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks [] for floatingip, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.638764 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a36101fe-eeb2-4826-905c-c334ecf042da req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "DELETE /v2.0/ports/dd8500c8-5962-4478-9c99-20281668d7c6 HTTP/1.1" status: 204  len: 173 time: 1.2339683
Jun 01 12:41:03.655350 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:03.656170 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] 10.222.0.81 "DELETE /v2.0/floatingips/0afcb26d-7fa1-4eb4-8fdc-c769751b6daf HTTP/1.1" status: 204  len: 168 time: 0.8999732
Jun 01 12:41:03.713162 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:41:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40a9b118-dd1d-4554-a8d9-e1264565f9ac x-openstack-request-id: req-40a9b118-dd1d-4554-a8d9-e1264565f9ac {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:41:03.713555 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "402e7587-9ab6-41f7-b49c-31f4d6825d0c", "name": "network-vif-deleted", "tag": "dd8500c8-5962-4478-9c99-20281668d7c6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:41:03.713947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-40a9b118-dd1d-4554-a8d9-e1264565f9ac {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:41:03.714542 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '402e7587-9ab6-41f7-b49c-31f4d6825d0c', 'name': 'network-vif-deleted', 'tag': 'dd8500c8-5962-4478-9c99-20281668d7c6', 'status': 'completed', 'code': 200}
Jun 01 12:41:03.748309 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:04.066426 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25ec57f0>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:04.070774 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] Checking router: 7e176463-91d5-4735-ab79-0ea7c34c6767 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:41:04.079848 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:04.080458 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25ec57f0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:04.258355 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:04.599753 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25ec57f0>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:04.603676 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-299e43ef-f63f-4959-a9ae-17ddd81afd01 None None] The sync data for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi is: [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:41:04.713764 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34430) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:04.780053 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:04.808217 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-100fb1e2-0281-4c61-9a64-fcd8a859092d None None] New status for floating IP 28591775-0985-4a1c-ba11-27f697b7aac9: DOWN {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:41:04.808766 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:04.865193 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:04.868996 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-47ef4735-552d-4f20-b876-f7f904e35048 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:04.973983 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3bc3847f-727c-4094-9173-73ca49a9dc5e,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:04.976630 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:04.987547 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:04.991442 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "DELETE /v2.0/security-groups/3bc3847f-727c-4094-9173-73ca49a9dc5e HTTP/1.1" status: 204  len: 168 time: 0.2743256
Jun 01 12:41:04.991872 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34438) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:05.011436 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.api.v2.resource [None req-618a380a-055c-4c1f-b9d8-649382f477a0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] show failed (client error): The resource could not be found.
Jun 01 12:41:05.012609 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-618a380a-055c-4c1f-b9d8-649382f477a0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups/3bc3847f-727c-4094-9173-73ca49a9dc5e HTTP/1.1" status: 404  len: 347 time: 0.0196579
Jun 01 12:41:05.015676 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34442) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:05.243812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Deleting port b3ee8d29-83cb-4f24-99f8-c93f41450f0d {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:41:05.244144 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:05.379489 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:05.379818 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:05.498672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Calling delete_port for b3ee8d29-83cb-4f24-99f8-c93f41450f0d owned by network:floatingip {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:05.605948 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:05.609495 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:05.655793 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event deleted for resources: {'Port': ['ID=b3ee8d29-83cb-4f24-99f8-c93f41450f0d,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:05.658149 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:05.747860 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:05.761710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:05.762815 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "DELETE /v2.0/floatingips/28591775-0985-4a1c-ba11-27f697b7aac9 HTTP/1.1" status: 204  len: 168 time: 0.7457547
Jun 01 12:41:06.220251 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34454) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:06.225829 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1631884731', 'description': 'tempest-description--1207439371'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:41:06.232222 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:06.236416 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:06.239318 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:06.245599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:06.256468 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.276843 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:06.280862 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group_rule and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:06.283719 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:06.289346 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:06.342343 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:41:06.365625 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.370186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.374165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-29c4e5fb-7a19-491d-abf3-5db2d83dde30 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:06.379047 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: dd8500c8-5962-4478-9c99-20281668d7c6 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:41:06.379518 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device dd8500c8-5962-4478-9c99-20281668d7c6 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:41:06.421221 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:06.424225 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:06.425591 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.429612 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.2055113
Jun 01 12:41:06.429976 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34464) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:06.435470 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'security_group_rule': {'security_group_id': '9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:41:06.441372 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:06.445879 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group_rule and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:06.448762 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:06.454374 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:06.471001 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.531415 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.535081 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.537045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:06.557768 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a691ad30-be56-453e-bbbe-2ba7a32669a9,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:06.561628 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:06.569641 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.570880 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a3e4bcfd-b949-4519-83a7-27fc1f17e42e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.1399240
Jun 01 12:41:06.573661 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34468) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:06.578740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'security_group_rule': {'security_group_id': '9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:41:06.584180 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:06.588394 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:security_group_rule and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:06.591515 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:06.597609 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:06.616502 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.683621 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.687168 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034333'] for security_group_rule, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.689125 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:06.711282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=39577fa6-b635-4fbe-bac4-af1da580c2d1,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:06.713602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:06.720611 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.721788 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7aa03148-c93b-4184-9a9a-b8bcad0863b0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1472166
Jun 01 12:41:06.725300 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34472) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:06.730420 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:41:06.736152 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:06.739997 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Usage tracker for resource:floatingip and tenant:dc771aee219e4d5d914602852a126ac3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:06.742859 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:06.749019 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:06.759033 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:06.897756 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.034776 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Allocated IP 172.27.3.33 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/3132c314-d50b-4088-b8c8-f37cb71dfca2) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:41:07.180557 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.208807 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.212888 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1834a67d-790d-4447-b9b6-0889c3cd5dd7 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:07.272495 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:41:07.275708 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:41:07.279383 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:41:07.313262 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'Port': ['ID=3132c314-d50b-4088-b8c8-f37cb71dfca2,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:07.324760 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:07.438996 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.496216 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.707140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.712423 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.716152 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e1cd3025-f6a4-499c-b61c-f2f283b0ebd8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:07.725993 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34482) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:07.819074 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'Port': ['ID=3132c314-d50b-4088-b8c8-f37cb71dfca2,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:07.823539 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:07.832451 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.857893 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:07.859299 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 1.1330597
Jun 01 12:41:08.084267 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-60a6ce61-cd17-4529-b7b7-87af7acd4bb7 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:41:08.099621 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-60a6ce61-cd17-4529-b7b7-87af7acd4bb7 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:41:08.100764 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-60a6ce61-cd17-4529-b7b7-87af7acd4bb7 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--1631884731&fields=id&tenant_id=dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 267 time: 0.0573373
Jun 01 12:41:08.253973 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-8556318a-7588-44b4-9cd3-dc6d4dd63fb6 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:08.255349 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-8556318a-7588-44b4-9cd3-dc6d4dd63fb6 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 816 time: 0.1467016
Jun 01 12:41:08.270709 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-fc1cd150-5a8f-4659-b97a-d5c530283e70 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/quotas/dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 375 time: 0.0089965
Jun 01 12:41:08.355097 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-7bade845-757d-4994-a1b3-13a71bd6af55 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:41:08.370717 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-7bade845-757d-4994-a1b3-13a71bd6af55 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:41:08.372082 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-7bade845-757d-4994-a1b3-13a71bd6af55 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0962832
Jun 01 12:41:08.501650 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:08.511553 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-5a164891-5227-4cd2-9266-3ee447d65ac4 service neutron] 10.222.0.81 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1278062
Jun 01 12:41:08.653987 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-c4020a11-c9fe-4d31-8187-355f802525fd service neutron] 10.222.0.81 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1249464
Jun 01 12:41:08.836043 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8bcaed60-8173-4889-a940-94beb82d83fc req-5606f2e4-ee6f-4b5f-84ca-a26cf3f7474f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 210 time: 0.0465529
Jun 01 12:41:09.073066 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Deleting port c41297e3-3729-4961-8e43-0de027b9fe9f {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:41:09.073401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:09.199151 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] For port c41297e3-3729-4961-8e43-0de027b9fe9f, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=c41297e3-3729-4961-8e43-0de027b9fe9f,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:09.199507 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:09.324343 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Calling delete_port for c41297e3-3729-4961-8e43-0de027b9fe9f owned by network:router_interface {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:09.486586 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:09.491045 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e4d0d303-b950-4ce9-a133-4f10fa1252fa tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:09.563177 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Pushing event deleted for resources: {'Port': ['ID=c41297e3-3729-4961-8e43-0de027b9fe9f,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:09.565722 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:09.845476 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:09.851300 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-be786fd2-4f5f-4558-afdf-6ac467e286b6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:09.919428 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-f535f987-ded6-4f8e-9402-1b4670e2df95 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:09.921085 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-f535f987-ded6-4f8e-9402-1b4670e2df95 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 816 time: 0.1640556
Jun 01 12:41:10.018908 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8a171127-d411-45b1-b6f5-5e20debe82ec req-e88605e6-5a2f-4996-851c-ec859c54333b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 210 time: 0.0527472
Jun 01 12:41:10.026309 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-8765b252-ed07-4379-8389-14e8e5172a0b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 380 time: 0.0960784
Jun 01 12:41:10.037130 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'port': {'device_id': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'admin_state_up': True, 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'security_groups': ['9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:41:10.185271 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:10.195355 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:10.205760 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Made reservation on behalf of dc771aee219e4d5d914602852a126ac3 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:41:10.209333 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:10.237558 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:41:10.378779 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Allocated IP 172.20.0.7 (a2f45554-20a3-4b02-a9ad-473554e8b2ed/37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5/79b6ede7-bda5-4259-8b84-707dcd1fda2e) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:41:10.410447 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:41:10.419236 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] Sync routers for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:41:10.425597 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] 10.222.0.81 "PUT /v2.0/routers/7383f9c7-1b26-40bd-a446-a8f7fc4b76ae/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6982975
Jun 01 12:41:10.426363 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34516) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:10.429604 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:10.431099 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25a3efd0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:10.616002 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:10.675295 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:10.692194 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Transition to ACTIVE for port object 79b6ede7-bda5-4259-8b84-707dcd1fda2e will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:41:10.716194 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks [] for router, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:10.718720 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:10.725608 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c9f8061b-57d7-4b33-93af-123e10b65dd0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:10.791551 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:41:10.794851 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:41:10.797286 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:41:10.840237 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:10.843357 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:10.876254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:10.876932 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:10.907100 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-210b657f-8d8a-4293-988a-8574354b384d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8739383
Jun 01 12:41:10.910567 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:10.920810 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Request body: {'port': {'device_id': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:41:10.949942 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25a3efd0>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110'}], 'enable_snat': True}, 'gw_port_id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:41:09Z', 'revision_number': 5, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port': {'id': 'ddafe269-b2d0-4254-9d25-4ed75004082e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:4f:7a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.110', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:34:19Z', 'updated_at': '2021-06-01T12:34:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:10.956855 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] Checking router: 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:41:10.968745 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] Routers {'7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:10.969685 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25a3efd0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:40:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:10.996025 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Deleting port ddafe269-b2d0-4254-9d25-4ed75004082e {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:41:10.996365 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.039730 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.127163 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-9cf62c30-f28b-44b5-b844-5671ebf68277 None None] Provisioning for port 79b6ede7-bda5-4259-8b84-707dcd1fda2e completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:41:11.142342 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-9cf62c30-f28b-44b5-b844-5671ebf68277 None None] Provisioning complete for port 79b6ede7-bda5-4259-8b84-707dcd1fda2e triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:41:11.142722 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9cf62c30-f28b-44b5-b844-5671ebf68277 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.158847 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] For port ddafe269-b2d0-4254-9d25-4ed75004082e, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=ddafe269-b2d0-4254-9d25-4ed75004082e,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:11.159195 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.182961 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] Set router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae gateway port host: None {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:11.300155 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25a3efd0>, [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:41:10Z', 'revision_number': 6, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port_host': None}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:11.307912 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ee364c8-d5f3-48de-a28e-73c2a9c90567 None None] The sync data for ids ['7383f9c7-1b26-40bd-a446-a8f7fc4b76ae'] in dv-cinder-793515-2-iscsi is: [{'id': '7383f9c7-1b26-40bd-a446-a8f7fc4b76ae', 'name': 'tempest-AttachVolumeTestJSON-357211251-router', 'tenant_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:34:17Z', 'updated_at': '2021-06-01T12:41:10Z', 'revision_number': 6, 'project_id': 'b09a17145ef0415faebc5bbdb71e3f3c', 'gw_port_host': None}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:41:11.311013 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-9cf62c30-f28b-44b5-b844-5671ebf68277 None None] Port 79b6ede7-bda5-4259-8b84-707dcd1fda2e cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:41:11.324583 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Calling delete_port for ddafe269-b2d0-4254-9d25-4ed75004082e owned by network:router_gateway {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:11.391097 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81864332-9d1a-448c-b850-c2a427416e47 req-c8bcd6c8-ef3f-485c-838c-9718708c2c16 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:11.392616 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-81864332-9d1a-448c-b850-c2a427416e47 req-c8bcd6c8-ef3f-485c-838c-9718708c2c16 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 931 time: 0.2400951
Jun 01 12:41:11.404812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 79b6ede7-bda5-4259-8b84-707dcd1fda2e {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:41:11.412292 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.427330 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Transition to ACTIVE for port object 79b6ede7-bda5-4259-8b84-707dcd1fda2e will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:41:11.431710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.436310 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:11.460151 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-81864332-9d1a-448c-b850-c2a427416e47 req-13456cd8-9111-47d6-9fd8-6712e446d251 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0602369
Jun 01 12:41:11.543708 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.549751 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-3036d883-a277-4955-89e2-5f8c1fd67b8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:11.593872 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:11.595386 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Pushing event deleted for resources: {'Port': ['ID=ddafe269-b2d0-4254-9d25-4ed75004082e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:11.625647 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:11.632285 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:11.683913 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Attempting to bind port 79b6ede7-bda5-4259-8b84-707dcd1fda2e on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:41:11.684239 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Attempting to bind port 79b6ede7-bda5-4259-8b84-707dcd1fda2e by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:41:11.684597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Attempting to bind port 79b6ede7-bda5-4259-8b84-707dcd1fda2e on network a2f45554-20a3-4b02-a9ad-473554e8b2ed {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:41:11.689640 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Port 79b6ede7-bda5-4259-8b84-707dcd1fda2e on network a2f45554-20a3-4b02-a9ad-473554e8b2ed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:41:11.690370 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Attempting to bind port 79b6ede7-bda5-4259-8b84-707dcd1fda2e on network a2f45554-20a3-4b02-a9ad-473554e8b2ed {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:41:11.695685 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 40, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:41:11.696078 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Checking segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:41:11.696464 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Bound using segment: {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:41:11.696925 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Bound port: 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b8b27531-fca1-4879-a221-022c8b3c93f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 756, 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:41:11.697268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.704872 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.793947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:41:11.797076 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:41:11.801885 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.805639 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b00fa5cc-4c06-485f-b862-19379770009f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:11.866250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:11.866858 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.868266 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] 10.222.0.95 "PUT /v2.0/ports/79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 200  len: 1093 time: 0.9529371
Jun 01 12:41:11.868795 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:41:11.871094 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ffafd053-a16d-46ea-98e2-145a36a47658" -d '{"events": [{"name": "network-changed", "server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:41:11.891129 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:11.894466 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:11.916624 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.919565 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.951386 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.952022 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7383f9c7-1b26-40bd-a446-a8f7fc4b76ae {{(pid=91978) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:41:11.959600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:41:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4fda8474-c0a4-415c-bbd0-089c8b5fac35 x-openstack-request-id: req-4fda8474-c0a4-415c-bbd0-089c8b5fac35 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:41:11.960176 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:41:11.960176 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-4fda8474-c0a4-415c-bbd0-089c8b5fac35 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:41:11.960632 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'status': 'completed', 'code': 200}
Jun 01 12:41:11.967905 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:11.969142 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-38ef7d0e-0c8b-41ce-8c13-0b7870c85635 admin admin] 10.222.0.81 "DELETE /v2.0/routers/7383f9c7-1b26-40bd-a446-a8f7fc4b76ae HTTP/1.1" status: 204  len: 168 time: 1.5418789
Jun 01 12:41:11.971820 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34526) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:12.000710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-e621db54-f74e-4f03-ada3-9e5aee32dde2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:12.002238 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-e621db54-f74e-4f03-ada3-9e5aee32dde2 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1096 time: 0.0805843
Jun 01 12:41:12.036673 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Deleting subnet 98e949e5-17bf-4e08-a5ea-232517784814 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:41:12.042800 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.083800 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-40e98102-672f-40c1-a309-53ffe53ab37b service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 200  len: 217 time: 0.0700603
Jun 01 12:41:12.119637 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.168473 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-f7d2a9ef-86d0-488c-978f-547ac1a681b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:12.169972 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-f7d2a9ef-86d0-488c-978f-547ac1a681b0 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0788033
Jun 01 12:41:12.211211 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device ddafe269-b2d0-4254-9d25-4ed75004082e no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:41:12.249598 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: ddafe269-b2d0-4254-9d25-4ed75004082e {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:41:12.250041 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device ddafe269-b2d0-4254-9d25-4ed75004082e not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:41:12.250563 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device c41297e3-3729-4961-8e43-0de027b9fe9f no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:41:12.252406 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.260892 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-6a52c4c2-1a3f-472a-918b-6d8973eb4528 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:12.262422 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-6a52c4c2-1a3f-472a-918b-6d8973eb4528 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0801694
Jun 01 12:41:12.287673 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: c41297e3-3729-4961-8e43-0de027b9fe9f {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:41:12.288103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device c41297e3-3729-4961-8e43-0de027b9fe9f not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:41:12.322572 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.343053 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.418612 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-fde41e1e-ef0c-4435-8560-12cc11509962 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1492531
Jun 01 12:41:12.566339 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-aa97c7dd-bdd6-49dd-ad2f-246c332f3d1f req-9bd303b0-d41f-4fb5-9686-8a65a8d20e73 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1402583
Jun 01 12:41:12.653763 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.662367 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1f90a5ee-c13d-44b8-a388-00de3adc7004 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:12.669451 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-2cc080af-6a1c-4d08-b1e0-3c37e0fd8891 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.709008 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=98e949e5-17bf-4e08-a5ea-232517784814,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:12.711218 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.717622 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:12.719136 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8919bbc6-51df-4c2a-a3d4-b82396e51326 None None] Network a43c69f6-c415-4ad5-8f5b-032eacaeb49e requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:41:12.725244 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2eb386f4-3574-496d-92ac-22528dccc557 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/98e949e5-17bf-4e08-a5ea-232517784814 HTTP/1.1" status: 204  len: 168 time: 0.7494733
Jun 01 12:41:12.725244 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34532) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:12.760870 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e996996-fb20-4e28-b3af-215d07eb9029 req-acd6f179-041c-415f-94fd-91e51bdb9158 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:12.762343 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6e996996-fb20-4e28-b3af-215d07eb9029 req-acd6f179-041c-415f-94fd-91e51bdb9158 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.1706836
Jun 01 12:41:12.768128 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-94de0d3e-c404-4420-be15-0cdfdbc21ca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:12.769838 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-94de0d3e-c404-4420-be15-0cdfdbc21ca1 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1096 time: 0.1551950
Jun 01 12:41:12.873379 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.880472 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6e996996-fb20-4e28-b3af-215d07eb9029 req-a5efba12-3858-40fa-8888-9662009d27e8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0724225
Jun 01 12:41:12.917557 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-e7f42a9a-3f43-4581-a078-9bd8eace94d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:12.919120 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-e7f42a9a-3f43-4581-a078-9bd8eace94d6 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.1387289
Jun 01 12:41:12.964572 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Deleting port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:41:12.965235 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:12.994520 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-f408f3be-98f6-4dd2-b6e1-f8521af4d9c0 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 200  len: 217 time: 0.0658200
Jun 01 12:41:12.995449 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] DHCP port deletion for a43c69f6-c415-4ad5-8f5b-032eacaeb49e request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:41:13.061377 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-4a60312d-e68d-4b0d-9d2a-71998898e4bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:13.062436 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Deleting port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:41:13.062818 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.063056 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-4a60312d-e68d-4b0d-9d2a-71998898e4bc service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0600238
Jun 01 12:41:13.072318 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] For port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:13.072318 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.158918 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-1ad25d63-6eb8-4d9e-9c69-2b2e59ef6963 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:13.160398 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-1ad25d63-6eb8-4d9e-9c69-2b2e59ef6963 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0908251
Jun 01 12:41:13.200348 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Calling delete_port for 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 owned by network:dhcp {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:13.200593 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] For port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,segment=NetworkSegment(8ba820a7-3059-4021-81f0-532d307e1908),segment_id=8ba820a7-3059-4021-81f0-532d307e1908)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:13.201266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.250435 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.255469 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ed455d30-d445-4e15-b2a5-f12c11582385 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:13.298181 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-232103e1-b8e7-4499-994a-b69b7046d110 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1303511
Jun 01 12:41:13.301919 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Pushing event deleted for resources: {'Port': ['ID=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:13.304356 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:13.307406 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] No DVR routers for this DVR port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 on host dv-cinder-793515-2-iscsi {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:41:13.329521 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Calling delete_port for 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:41:13.373702 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.377257 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-7d11a770-5b57-46d2-9cd1-fed73e68f33e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:13.418199 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Pushing event deleted for resources: {'Port': ['ID=66529bfc-ad3a-43ec-a3aa-c7d360ab9c17,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:13.421602 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:13.423951 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] No DVR routers for this DVR port 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:41:13.426677 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.439159 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ffafd053-a16d-46ea-98e2-145a36a47658 req-62af7015-9c5f-4800-87e0-7162cd066786 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1326859
Jun 01 12:41:13.443507 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a2512c700>,) {'filters': {'network_id': ['a43c69f6-c415-4ad5-8f5b-032eacaeb49e']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:13.456484 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2512c700>, '8ba820a7-3059-4021-81f0-532d307e1908') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:13.456805 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2512c700>, '8ba820a7-3059-4021-81f0-532d307e1908') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:13.468794 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.484975 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.491077 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Releasing vlan 765 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:41:13.491480 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:41:13.504417 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:41:13.585984 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.590561 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:13.603297 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.614858 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Pushing event deleted for resources: {'Network': ['ID=a43c69f6-c415-4ad5-8f5b-032eacaeb49e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:13.618962 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:13.627091 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] 10.222.0.81 "DELETE /v2.0/networks/a43c69f6-c415-4ad5-8f5b-032eacaeb49e HTTP/1.1" status: 204  len: 168 time: 0.9012325
Jun 01 12:41:13.740160 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34538) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:13.788279 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-bfb84abc-d089-4675-bc57-a8cca63b314f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=b09a17145ef0415faebc5bbdb71e3f3c&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0468283
Jun 01 12:41:13.790551 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34542) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:13.847849 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7ab6a916-4f7a-47a4-a500-b848d31213d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.862139 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.875553 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7ab6a916-4f7a-47a4-a500-b848d31213d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.927458 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7ab6a916-4f7a-47a4-a500-b848d31213d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.932229 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:13.945221 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ab6a916-4f7a-47a4-a500-b848d31213d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73d23c15-a0c6-408e-ba3a-bedc4eece2bd,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:13.949207 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7ab6a916-4f7a-47a4-a500-b848d31213d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:13.956348 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7ab6a916-4f7a-47a4-a500-b848d31213d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:13.957476 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7ab6a916-4f7a-47a4-a500-b848d31213d0 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/73d23c15-a0c6-408e-ba3a-bedc4eece2bd HTTP/1.1" status: 204  len: 168 time: 0.1660688
Jun 01 12:41:14.096017 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b041cf-56fb-4af4-92fb-31a42f3d0e97 req-f99dce4e-ef37-444a-a9c3-5646d9b1f14a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:14.096738 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-c8b041cf-56fb-4af4-92fb-31a42f3d0e97 req-f99dce4e-ef37-444a-a9c3-5646d9b1f14a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Synchronizing usage tracker for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:41:14.112875 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-c8b041cf-56fb-4af4-92fb-31a42f3d0e97 req-f99dce4e-ef37-444a-a9c3-5646d9b1f14a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Unset dirty status for tenant:dc771aee219e4d5d914602852a126ac3 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:41:14.114133 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c8b041cf-56fb-4af4-92fb-31a42f3d0e97 req-f99dce4e-ef37-444a-a9c3-5646d9b1f14a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.1007886
Jun 01 12:41:14.167541 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c8b041cf-56fb-4af4-92fb-31a42f3d0e97 req-e4db01c3-d749-431a-93a2-33b7a08dd162 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433552
Jun 01 12:41:14.173463 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:41:14.210717 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:41:14.211408 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 66529bfc-ad3a-43ec-a3aa-c7d360ab9c17 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:41:14.404042 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:41:14.541918 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:14.555948 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'port_id': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'mac_address': 'fa:16:3e:54:1d:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 756, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:41:14.612169 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:14.629815 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79b6ede7-bda5-4259-8b84-707dcd1fda2e {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:41:14.645770 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:14.649976 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:14.652495 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:14.719951 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:14.728334 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.728702 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.729040 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.729375 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.729795 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.730030 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.730350 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.730671 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.731001 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.731315 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.731633 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.731948 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:14.736568 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:14.956386 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['79b6ede7-bda5-4259-8b84-707dcd1fda2e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:41:15.375923 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea88f883-7add-42db-9bbf-2599186bc0a6 req-6c9ea711-08d2-417c-9170-dacbb4174788 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:15.377409 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ea88f883-7add-42db-9bbf-2599186bc0a6 req-6c9ea711-08d2-417c-9170-dacbb4174788 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 944 time: 0.0924187
Jun 01 12:41:15.419587 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:15.427208 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ea88f883-7add-42db-9bbf-2599186bc0a6 req-59d7cc89-cb18-4eec-9ec7-b0bee1114659 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0441804
Jun 01 12:41:15.876723 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:41:16.420335 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:41:16.491996 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 79b6ede7-bda5-4259-8b84-707dcd1fda2e completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:41:16.496626 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 79b6ede7-bda5-4259-8b84-707dcd1fda2e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:41:16.497007 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:16.616969 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:16.632794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12a85dc7-f26a-48c7-aa87-ea4e43edaecc req-499de044-73b1-4a6a-85a4-256ae77c2498 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:16.635162 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-12a85dc7-f26a-48c7-aa87-ea4e43edaecc req-499de044-73b1-4a6a-85a4-256ae77c2498 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 944 time: 0.0810297
Jun 01 12:41:16.644687 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:41:16.646881 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d1838a3-502d-45bc-9912-f5a1de9e44cd" -d '{"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-plugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:41:16.655822 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:41:16.659938 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:16.661922 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:16.682800 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-12a85dc7-f26a-48c7-aa87-ea4e43edaecc req-0a2c0198-1dce-4c63-8353-7de600d35b31 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409627
Jun 01 12:41:16.728342 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:16.731611 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:16.743628 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:41:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08b0f831-de92-4cb7-ab38-074dfdc0a3a9 x-openstack-request-id: req-08b0f831-de92-4cb7-ab38-074dfdc0a3a9 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:41:16.743910 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-plugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:41:16.744173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-08b0f831-de92-4cb7-ab38-074dfdc0a3a9 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:41:16.744595 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'code': 200}
Jun 01 12:41:16.996379 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0bf96a-5f33-431b-9d1c-d8af3bdbccf3 req-07c5c55e-38ca-4ff8-accb-79c36f65ae0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:16.997854 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b0bf96a-5f33-431b-9d1c-d8af3bdbccf3 req-07c5c55e-38ca-4ff8-accb-79c36f65ae0f service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1098 time: 0.0764074
Jun 01 12:41:17.038777 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2b0bf96a-5f33-431b-9d1c-d8af3bdbccf3 req-a86da755-4d8a-4f17-81ca-fd5023218206 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0332172
Jun 01 12:41:17.873419 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b8f832-f4f7-4a8c-91d9-8cfab1bc160d req-3e629d2f-bf80-48db-a638-dcb13e1165f8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:17.874891 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f8b8f832-f4f7-4a8c-91d9-8cfab1bc160d req-3e629d2f-bf80-48db-a638-dcb13e1165f8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0809853
Jun 01 12:41:17.924466 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f8b8f832-f4f7-4a8c-91d9-8cfab1bc160d req-94095f63-c0f1-4a77-938c-527d7551dbee tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0438769
Jun 01 12:41:19.113807 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2984f6cc-7eb3-4f16-86ea-187592d09836 req-6643fc5a-9bfd-428c-948e-69786c4373c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:19.115262 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2984f6cc-7eb3-4f16-86ea-187592d09836 req-6643fc5a-9bfd-428c-948e-69786c4373c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0809202
Jun 01 12:41:19.160388 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2984f6cc-7eb3-4f16-86ea-187592d09836 req-b62519fb-b938-4d41-b8c5-b896e413cc10 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388882
Jun 01 12:41:20.440878 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3f856c-a109-4de6-94fd-6fa51afd041c req-1fad1b20-6c05-4591-aaa7-c86cb5eee9f5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:20.442229 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5b3f856c-a109-4de6-94fd-6fa51afd041c req-1fad1b20-6c05-4591-aaa7-c86cb5eee9f5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1735787
Jun 01 12:41:20.487416 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5b3f856c-a109-4de6-94fd-6fa51afd041c req-24e7d985-068e-48da-a1f7-3103429c5c57 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392542
Jun 01 12:41:21.674077 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26cb04cf-9c67-4768-9cf4-0e8c4c943afd req-024a81d2-8b0a-4edc-8dda-88b4be08e890 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:21.675522 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-26cb04cf-9c67-4768-9cf4-0e8c4c943afd req-024a81d2-8b0a-4edc-8dda-88b4be08e890 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0789442
Jun 01 12:41:21.724337 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-26cb04cf-9c67-4768-9cf4-0e8c4c943afd req-715cb63d-1a9e-4b84-97c3-b516756ab41c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0424662
Jun 01 12:41:21.905680 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa2d306b-4d27-4db8-ac36-7077603b6f2c req-93989372-2e44-4b14-8c03-70a4d3651486 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:21.907030 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fa2d306b-4d27-4db8-ac36-7077603b6f2c req-93989372-2e44-4b14-8c03-70a4d3651486 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0792308
Jun 01 12:41:21.916648 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34644) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:21.921641 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Request body: {'floatingip': {'port_id': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:41:21.998142 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:22.679314 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:22.683433 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:22.858499 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Floating IP ed705b00-9053-4494-a4c2-691fd296b3ad associated. External IP: 172.27.3.33, port: 79b6ede7-bda5-4259-8b84-707dcd1fda2e.
Jun 01 12:41:23.207992 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Router 7e176463-91d5-4735-ab79-0ea7c34c6767 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:41:23.386723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:41:23.391160 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:23.396252 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] Sync routers for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:41:23.407155 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:23.407762 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e1fb20>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:41:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:23.448413 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-d2889f83-b61e-45ef-af1c-f1facbff8159 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "PUT /v2.0/floatingips/ed705b00-9053-4494-a4c2-691fd296b3ad HTTP/1.1" status: 200  len: 990 time: 1.5277615
Jun 01 12:41:23.448413 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:41:23.449055 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-faa62627-4ca3-4744-ba26-d87e79e5391b" -d '{"events": [{"name": "network-changed", "server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:41:23.498862 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:41:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e0b536f-725b-4e47-ac29-261699c615f3 x-openstack-request-id: req-0e0b536f-725b-4e47-ac29-261699c615f3 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:41:23.499175 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:41:23.499455 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-0e0b536f-725b-4e47-ac29-261699c615f3 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:41:23.499864 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'status': 'completed', 'code': 200}
Jun 01 12:41:23.585469 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:23.599357 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-5a94b85a-e344-4f1e-99d3-0c6b2836f2f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:23.600875 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-5a94b85a-e344-4f1e-99d3-0c6b2836f2f1 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1098 time: 0.0772412
Jun 01 12:41:23.831799 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-22a99fce-b67c-43c9-b2cf-64f184e60a5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:23.833268 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-22a99fce-b67c-43c9-b2cf-64f184e60a5b service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.2248383
Jun 01 12:41:23.941914 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-5cbf933b-bb06-43ff-9738-9792b844f22e service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 200  len: 998 time: 0.1006644
Jun 01 12:41:23.947249 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e1fb20>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'ed705b00-9053-4494-a4c2-691fd296b3ad', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'floating_ip_address': '172.27.3.33', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'port_id': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'mac_address': 'fa:16:3e:54:1d:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:41:07Z', 'updated_at': '2021-06-01T12:41:22Z', 'revision_number': 1, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:23.951185 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] Checking router: 7e176463-91d5-4735-ab79-0ea7c34c6767 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:41:23.959535 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:41:23.960135 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e1fb20>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:41:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:24.014374 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-65ed31ec-55a9-4204-b7fc-689d78faf81a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:24.015881 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-65ed31ec-55a9-4204-b7fc-689d78faf81a service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0672555
Jun 01 12:41:24.096293 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-475f5487-3a69-4956-8151-7eb89c72f90c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:24.098075 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-475f5487-3a69-4956-8151-7eb89c72f90c service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0743072
Jun 01 12:41:24.136193 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34680) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:24.171264 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:41:24.242900 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-28ded7cd-e826-4d6e-99c5-4119a44d52a8 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1368504
Jun 01 12:41:24.267729 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:24.283175 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:24.287124 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Usage tracker for resource:security_group_rule and tenant:e40b438188d14aed82713a94fd16c37c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:24.290101 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:24.295946 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:24.382648 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-faa62627-4ca3-4744-ba26-d87e79e5391b req-e2115cda-3981-421c-80a7-c4ebe598fb36 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1314898
Jun 01 12:41:24.387547 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:24.392100 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:24.399773 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8f87d914-3e44-4bd3-af06-9b4bf102ffd1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:24.445243 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e40b438188d14aed82713a94fd16c37c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3070602
Jun 01 12:41:24.445972 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4de99d70-54c1-435e-b660-a5ef09a984ad,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:24.450297 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6aa0c624-023f-4e3f-bab3-dd55def2c85e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:24.450574 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34686) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:24.524234 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-70b9f4da-08f9-4769-b75f-25d34bd7b1bd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:24.550180 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-70b9f4da-08f9-4769-b75f-25d34bd7b1bd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:24.567082 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e1fb20>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'ed705b00-9053-4494-a4c2-691fd296b3ad', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'floating_ip_address': '172.27.3.33', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'port_id': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'mac_address': 'fa:16:3e:54:1d:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:41:07Z', 'updated_at': '2021-06-01T12:41:22Z', 'revision_number': 1, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:41:24.573529 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9b66040-19d2-4194-b3e2-905b56375d88 None None] The sync data for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi is: [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': 'ed705b00-9053-4494-a4c2-691fd296b3ad', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'floating_ip_address': '172.27.3.33', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'port_id': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 576, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'mac_address': 'fa:16:3e:54:1d:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:41:07Z', 'updated_at': '2021-06-01T12:41:22Z', 'revision_number': 1, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:41:24.608920 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-70b9f4da-08f9-4769-b75f-25d34bd7b1bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:24.612858 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6495a376-8af1-4b6e-96cb-cd0e660addf4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:24.624771 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b9f4da-08f9-4769-b75f-25d34bd7b1bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4de99d70-54c1-435e-b660-a5ef09a984ad,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:24.628553 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-70b9f4da-08f9-4769-b75f-25d34bd7b1bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:24.632921 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-70b9f4da-08f9-4769-b75f-25d34bd7b1bd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:24.634560 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-70b9f4da-08f9-4769-b75f-25d34bd7b1bd admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4de99d70-54c1-435e-b660-a5ef09a984ad HTTP/1.1" status: 204  len: 168 time: 0.1820817
Jun 01 12:41:24.807563 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4702431-a1e3-4727-81dd-e6bdca96d04c None None] New status for floating IP ed705b00-9053-4494-a4c2-691fd296b3ad: ACTIVE {{(pid=91980) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:41:26.410362 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34738) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:26.525180 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:26.538732 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:26.543170 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Usage tracker for resource:security_group_rule and tenant:ebc7b966458e424fae6da61500509d87 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:26.546006 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:26.551692 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:26.642718 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:26.646492 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:26.655412 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c76f96e5-aac3-4749-854b-9617a061832d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:26.694534 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ebc7b966458e424fae6da61500509d87&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2831349
Jun 01 12:41:26.695437 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a93606c8-a0c7-4605-8133-4f33ffacc56a,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:26.697906 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34744) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:26.699102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:26.755730 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:26.784719 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:26.837415 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:26.843361 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-00625ce4-c2a4-4655-9b99-8ecef70aff87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:26.856528 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a93606c8-a0c7-4605-8133-4f33ffacc56a,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:26.858919 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:26.869324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:26.872999 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a93606c8-a0c7-4605-8133-4f33ffacc56a HTTP/1.1" status: 204  len: 168 time: 0.1715970
Jun 01 12:41:27.187472 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34754) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:27.205719 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:27.220273 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:27.224193 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Usage tracker for resource:security_group_rule and tenant:c2df7d0d308140d2af0d26c0b5ecc509 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:27.227121 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:27.233589 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:27.317625 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:27.321811 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:27.328929 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-08da903f-c101-42e7-8c30-4fb36c006fb9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:27.370100 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca40ba54-39ad-4662-93f8-289792226d70,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:27.374407 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c2df7d0d308140d2af0d26c0b5ecc509&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1858582
Jun 01 12:41:27.375330 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:27.376976 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34758) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:27.438548 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-671aa2b5-9f9c-4e83-8dff-a506ac99212b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:27.464657 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-671aa2b5-9f9c-4e83-8dff-a506ac99212b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:27.514441 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-671aa2b5-9f9c-4e83-8dff-a506ac99212b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:27.518222 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-38519a8c-a75e-49c6-86c1-0e830786490b tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:27.531735 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-671aa2b5-9f9c-4e83-8dff-a506ac99212b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca40ba54-39ad-4662-93f8-289792226d70,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:27.534743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-671aa2b5-9f9c-4e83-8dff-a506ac99212b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:27.536775 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-671aa2b5-9f9c-4e83-8dff-a506ac99212b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:27.537816 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-671aa2b5-9f9c-4e83-8dff-a506ac99212b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/ca40ba54-39ad-4662-93f8-289792226d70 HTTP/1.1" status: 204  len: 168 time: 0.1599636
Jun 01 12:41:29.362577 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34822) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:29.482557 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:29.496478 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:29.500275 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Usage tracker for resource:security_group_rule and tenant:42f2ffaa82fa43e3a7a0665d09a29490 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:29.503062 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:29.509158 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:29.589355 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:29.593017 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:29.599655 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0bd99c72-9246-443a-acaf-53f46fea9908 tempest-VolumesNegativeTest-2077574668 tempest-VolumesNegativeTest-2077574668-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:29.640839 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=42f2ffaa82fa43e3a7a0665d09a29490&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2771847
Jun 01 12:41:29.641747 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4e8688d-6fe1-4996-baae-b445979c4ddc,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:29.643498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34828) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:29.649203 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.649569 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.649924 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.650315 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.650663 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.651018 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.651356 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.651694 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.652033 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.652366 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.652773 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.653050 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:29.657234 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:29.707803 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:29.733510 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:29.788710 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:29.792603 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e3912ebe-884e-455e-afe7-4a360340a4bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:29.807775 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4e8688d-6fe1-4996-baae-b445979c4ddc,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:29.812278 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:29.814278 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:29.815403 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/e4e8688d-6fe1-4996-baae-b445979c4ddc HTTP/1.1" status: 204  len: 168 time: 0.1709173
Jun 01 12:41:30.106742 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34836) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:30.125187 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:30.140270 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:30.144201 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Usage tracker for resource:security_group_rule and tenant:05dc9c3d87cf40b4a4f6058f8d662221 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:30.147156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:30.153923 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:30.239887 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:30.244620 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:30.251982 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0c3d6ab1-6c99-4e12-8ea8-730e38ed3b6c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:30.292057 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=05dc9c3d87cf40b4a4f6058f8d662221&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1842172
Jun 01 12:41:30.292987 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4c774c5-7fed-4385-8cba-16a5510ace0b,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:30.294738 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34840) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:30.300701 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.301075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.301440 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.301802 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.302156 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.302508 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.302857 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.303204 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.303552 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.303897 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.304239 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.304604 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:41:30.308842 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:30.356366 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bba6c3e1-c5b3-472f-bd03-77a01a12c077 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:30.383766 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bba6c3e1-c5b3-472f-bd03-77a01a12c077 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:30.448968 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bba6c3e1-c5b3-472f-bd03-77a01a12c077 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:30.452717 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f037dc6f-b9b5-4876-bfa7-90b9890c0bfe admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:30.467190 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bba6c3e1-c5b3-472f-bd03-77a01a12c077 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4c774c5-7fed-4385-8cba-16a5510ace0b,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:30.475141 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bba6c3e1-c5b3-472f-bd03-77a01a12c077 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:30.486637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-bba6c3e1-c5b3-472f-bd03-77a01a12c077 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:30.488008 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-bba6c3e1-c5b3-472f-bd03-77a01a12c077 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/c4c774c5-7fed-4385-8cba-16a5510ace0b HTTP/1.1" status: 204  len: 168 time: 0.1922898
Jun 01 12:41:37.853067 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34980) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:37.970356 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:37.984115 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:37.987866 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Usage tracker for resource:security_group_rule and tenant:750df721cf6b46e89a41301a5370a408 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:37.990677 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:37.996783 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:38.077386 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.081272 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.087932 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:38.132741 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=750df721cf6b46e89a41301a5370a408&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2785463
Jun 01 12:41:38.134310 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70065a31-70b2-4331-b929-ca182b6f9c87,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:38.136063 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 34986) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:38.137783 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:38.195022 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e2f4c004-8765-4084-9343-c760f517409c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.220385 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e2f4c004-8765-4084-9343-c760f517409c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.273472 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e2f4c004-8765-4084-9343-c760f517409c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.277421 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-13c1bebb-c99b-43d7-af24-ab9d2105a943 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:38.291070 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2f4c004-8765-4084-9343-c760f517409c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70065a31-70b2-4331-b929-ca182b6f9c87,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:38.293771 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e2f4c004-8765-4084-9343-c760f517409c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:38.297036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-e2f4c004-8765-4084-9343-c760f517409c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.300612 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-e2f4c004-8765-4084-9343-c760f517409c admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/70065a31-70b2-4331-b929-ca182b6f9c87 HTTP/1.1" status: 204  len: 168 time: 0.1610062
Jun 01 12:41:38.585073 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 34996) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:38.603241 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.617459 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:38.622695 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Usage tracker for resource:security_group_rule and tenant:f2f2517028eb47d58fe402f6f200e580 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:38.625646 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:38.631407 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:38.714092 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.719018 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.726072 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-6d8337a8-89c9-4d9d-9e82-f3c05dc49c45 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:38.766379 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=552597e4-73ee-4705-b30f-62cf792eeea7,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:38.769447 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:38.772068 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-abd71a6d-ca04-4e17-a268-aa3eef573fa8 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f2f2517028eb47d58fe402f6f200e580&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1859827
Jun 01 12:41:38.776357 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35000) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:38.838568 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8c6e2c15-3bd8-4dd7-90c4-1b61df794a86 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.864243 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8c6e2c15-3bd8-4dd7-90c4-1b61df794a86 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.916774 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8c6e2c15-3bd8-4dd7-90c4-1b61df794a86 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.920476 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f89197bc-fed6-457f-a640-a36af1aab367 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:38.935192 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c6e2c15-3bd8-4dd7-90c4-1b61df794a86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=552597e4-73ee-4705-b30f-62cf792eeea7,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:38.937495 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8c6e2c15-3bd8-4dd7-90c4-1b61df794a86 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:38.949855 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8c6e2c15-3bd8-4dd7-90c4-1b61df794a86 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:38.953563 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-8c6e2c15-3bd8-4dd7-90c4-1b61df794a86 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/552597e4-73ee-4705-b30f-62cf792eeea7 HTTP/1.1" status: 204  len: 168 time: 0.1736784
Jun 01 12:41:39.850304 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b41a4920-e2db-4a30-ab52-0433850f5b04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:41.345805 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-f1ff2840-4c47-4cef-a046-95ab53346788 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0765367
Jun 01 12:41:41.490831 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-1695e2aa-72b2-4d1c-91c8-32aa7f0c2cba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:41.492345 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-1695e2aa-72b2-4d1c-91c8-32aa7f0c2cba service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1098 time: 0.0757647
Jun 01 12:41:41.643255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-3a86c014-4d15-4f00-9c4b-816cbd46a742 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:41.644714 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-3a86c014-4d15-4f00-9c4b-816cbd46a742 service neutron] 10.222.0.95 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 907 time: 0.1320825
Jun 01 12:41:41.750919 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-98363095-5656-4448-b17c-d1f87394ed62 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 1001 time: 0.0985780
Jun 01 12:41:41.815715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-465c7689-12a3-4512-a09c-58c06358833c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:41.817159 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-465c7689-12a3-4512-a09c-58c06358833c service neutron] 10.222.0.95 "GET /v2.0/subnets?id=167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 200  len: 845 time: 0.0596771
Jun 01 12:41:41.970810 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-82004f8b-da86-4689-b285-fe5657c8e520 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:41:41.972292 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-82004f8b-da86-4689-b285-fe5657c8e520 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=8c58f5e9-2554-475d-a254-a02b35fda51b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1476166
Jun 01 12:41:42.105782 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-eb377394-4b00-426f-9834-3602c6e2e220 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1262355
Jun 01 12:41:42.133090 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:42.245573 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57769c26-d7cd-4f41-8bec-fff3a6441ee6 req-6fccd58e-0d12-47a8-a5d9-7b44e25ecee1 service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1318529
Jun 01 12:41:42.314752 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:42.674020 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-069934f1-81e6-4d80-b0a9-f1c49ed9e7c9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:43.869662 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:45.416210 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:52.876257 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:41:58.720309 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35178) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:58.856134 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:58.870926 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:41:58.875175 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Usage tracker for resource:security_group_rule and tenant:69365a27acbf47ce9603f8b9910692f1 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:41:58.878061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:41:58.883679 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:41:58.969020 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:58.972649 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:58.979336 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ee7f636a-f2c3-455c-b538-3e5ca386cb62 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:59.017290 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37a54d72-790b-4c3a-b4c9-ae9195c69169,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:59.021508 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=69365a27acbf47ce9603f8b9910692f1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3001761
Jun 01 12:41:59.022405 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:59.024058 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35184) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:41:59.084435 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c3f5fd02-a2a1-46ed-9b40-552bc51ce6a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:59.110337 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c3f5fd02-a2a1-46ed-9b40-552bc51ce6a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:59.162614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c3f5fd02-a2a1-46ed-9b40-552bc51ce6a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:59.169951 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1d7fa939-877f-4ee9-a795-6b706a4a75c0 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:41:59.186058 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f5fd02-a2a1-46ed-9b40-552bc51ce6a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37a54d72-790b-4c3a-b4c9-ae9195c69169,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:41:59.188368 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c3f5fd02-a2a1-46ed-9b40-552bc51ce6a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:41:59.193086 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c3f5fd02-a2a1-46ed-9b40-552bc51ce6a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:41:59.194190 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c3f5fd02-a2a1-46ed-9b40-552bc51ce6a1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/37a54d72-790b-4c3a-b4c9-ae9195c69169 HTTP/1.1" status: 204  len: 168 time: 0.1692324
Jun 01 12:42:09.427649 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e9ada2-575d-42b5-9cb0-464e46b2e7ed req-1475c2d0-19b9-4ffb-ae4f-6b0b00439fe8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:09.429829 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e9ada2-575d-42b5-9cb0-464e46b2e7ed req-1475c2d0-19b9-4ffb-ae4f-6b0b00439fe8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0797074
Jun 01 12:42:09.477885 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e9ada2-575d-42b5-9cb0-464e46b2e7ed req-d91d1e2a-ff32-47ee-9b31-c34a4f9647cc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421832
Jun 01 12:42:09.842628 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e1a55aa0-940d-48eb-b0fe-4d2661a3db3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:10.673598 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a33607-d7f1-44b2-b229-e3fbfdcfabb1 req-1df66487-54a4-426b-9fcb-9b4a032e3970 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:10.675075 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e5a33607-d7f1-44b2-b229-e3fbfdcfabb1 req-1df66487-54a4-426b-9fcb-9b4a032e3970 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0791998
Jun 01 12:42:10.722673 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e5a33607-d7f1-44b2-b229-e3fbfdcfabb1 req-0fb159f4-a80b-4e8d-8b1b-b7d0fce59018 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414186
Jun 01 12:42:11.909276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f174228d-0cf8-4e38-a39c-fe4fd8ade636 req-ab7365e8-85cf-48b3-a59a-26b8c952b1ee tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:11.910742 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f174228d-0cf8-4e38-a39c-fe4fd8ade636 req-ab7365e8-85cf-48b3-a59a-26b8c952b1ee tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0800247
Jun 01 12:42:11.955880 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f174228d-0cf8-4e38-a39c-fe4fd8ade636 req-9e1aa30a-b819-496f-a1d2-de0d89771bbd tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393572
Jun 01 12:42:12.134140 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:12.317720 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:12.664947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35372) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:12.679266 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-21ccce07-ed4f-4c03-b737-e2eab0bcd464 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:12.926109 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Deleting port cabbdb3b-99a1-4827-8288-2d2bc4e300a8 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:12.926671 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.045834 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.046163 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.154927 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c4beaee-e321-4326-aa6f-02e24276d6a7 req-3c1c2456-7551-4574-9433-e389f48cf9b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:13.156608 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3c4beaee-e321-4326-aa6f-02e24276d6a7 req-3c1c2456-7551-4574-9433-e389f48cf9b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0873919
Jun 01 12:42:13.178926 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Calling delete_port for cabbdb3b-99a1-4827-8288-2d2bc4e300a8 owned by network:floatingip {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:13.212801 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3c4beaee-e321-4326-aa6f-02e24276d6a7 req-80417bb0-4a74-4e85-9ef4-dabd7476b2ff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0504568
Jun 01 12:42:13.323809 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.328768 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:13.371703 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event deleted for resources: {'Port': ['ID=cabbdb3b-99a1-4827-8288-2d2bc4e300a8,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:13.406781 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:13.466500 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for floatingip, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.466828 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Floating IP ec3f8f9f-443d-4cee-bb11-2ec992472a3a disassociated (deleted). External IP: 172.27.3.155, port: db567b77-bbc1-4e8f-95eb-46817c3ec9d6.
Jun 01 12:42:13.531875 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35386) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:13.659858 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.674733 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:42:13.678514 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Usage tracker for resource:security_group_rule and tenant:ab3e815b5f1c4a81ba7c90238d721aea is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:42:13.681337 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:42:13.687735 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:42:13.771528 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.775429 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.784145 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e6ab5633-058b-4877-b7e7-b20282e1371e tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:13.828075 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ab3e815b5f1c4a81ba7c90238d721aea&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2950742
Jun 01 12:42:13.829716 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af67aaf0-1871-4099-8a19-0e07a59a4840,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:13.831967 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35392) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:13.834412 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:13.870374 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.894323 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-88017ad3-86fc-4024-84e8-7945290ca713 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.901589 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Router 25520016-154b-4bde-8e0c-2e8576327298 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:42:13.924106 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-88017ad3-86fc-4024-84e8-7945290ca713 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.981343 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-88017ad3-86fc-4024-84e8-7945290ca713 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:13.985573 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-3e22cbf2-67b4-41c3-83d4-957b832ce3d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:13.996972 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88017ad3-86fc-4024-84e8-7945290ca713 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af67aaf0-1871-4099-8a19-0e07a59a4840,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:14.000754 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-88017ad3-86fc-4024-84e8-7945290ca713 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:14.004484 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-88017ad3-86fc-4024-84e8-7945290ca713 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:14.005564 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-88017ad3-86fc-4024-84e8-7945290ca713 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/af67aaf0-1871-4099-8a19-0e07a59a4840 HTTP/1.1" status: 204  len: 168 time: 0.1726959
Jun 01 12:42:14.113599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:42:14.126299 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] Sync routers for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:42:14.148447 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:14.163434 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:14.164072 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d1d6d0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:14.217154 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "DELETE /v2.0/floatingips/ec3f8f9f-443d-4cee-bb11-2ec992472a3a HTTP/1.1" status: 204  len: 168 time: 1.5507674
Jun 01 12:42:14.219100 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:14.224970 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a0e599f-7f68-4c73-9951-ced2ec740426" -d '{"events": [{"name": "network-changed", "server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:14.309970 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbe306a8-e6ac-406d-bb4e-8a8a47c7c3dc x-openstack-request-id: req-dbe306a8-e6ac-406d-bb4e-8a8a47c7c3dc {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:14.310306 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:14.310598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-dbe306a8-e6ac-406d-bb4e-8a8a47c7c3dc {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:14.311082 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'status': 'completed', 'code': 200}
Jun 01 12:42:14.444219 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-28b09f85-ead3-4ee8-9e8f-b2689929dda0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:14.447061 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-28b09f85-ead3-4ee8-9e8f-b2689929dda0 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 1098 time: 0.1099792
Jun 01 12:42:14.466671 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:14.669367 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-f6a7378a-30f2-4b8e-83d8-e990fad794fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:14.671530 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-f6a7378a-30f2-4b8e-83d8-e990fad794fd service neutron] 10.222.0.95 "GET /v2.0/networks?id=8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 200  len: 907 time: 0.2175829
Jun 01 12:42:14.696345 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c41555e1-6146-4c50-82e2-49a3be50aba0 req-6a8c7034-5950-4a36-a168-de97441e788e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:14.715723 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c41555e1-6146-4c50-82e2-49a3be50aba0 req-6a8c7034-5950-4a36-a168-de97441e788e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.2231636
Jun 01 12:42:14.795101 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c41555e1-6146-4c50-82e2-49a3be50aba0 req-53c5cce7-fcce-4faa-9d05-2ba2eec7b7c1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0763772
Jun 01 12:42:14.867841 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d1d6d0>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:17Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:14.873084 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] Checking router: 25520016-154b-4bde-8e0c-2e8576327298 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:42:14.882951 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:14.883601 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25d1d6d0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:14.899656 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-602f46d4-ef2c-4496-b123-1cf8a993c169 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 200  len: 217 time: 0.2208145
Jun 01 12:42:14.989924 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-4a3f8927-441c-4afc-8461-a2b32fe083a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:14.991370 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-4a3f8927-441c-4afc-8461-a2b32fe083a6 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 200  len: 845 time: 0.0843749
Jun 01 12:42:15.051575 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50cb51aa-2d1c-4325-a05a-e2aebecafa4e req-c27933fe-fe54-41cf-8aa4-7c21c568742c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:15.052325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-50cb51aa-2d1c-4325-a05a-e2aebecafa4e req-c27933fe-fe54-41cf-8aa4-7c21c568742c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Synchronizing usage tracker for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:42:15.089081 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35434) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:15.097730 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-50cb51aa-2d1c-4325-a05a-e2aebecafa4e req-c27933fe-fe54-41cf-8aa4-7c21c568742c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Unset dirty status for tenant:a4d9bab00fe345e0b899bc42ea4416e0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:42:15.098882 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-50cb51aa-2d1c-4325-a05a-e2aebecafa4e req-c27933fe-fe54-41cf-8aa4-7c21c568742c tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.2487295
Jun 01 12:42:15.124607 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-67cca170-5bc2-4531-9533-f5e64b9811ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:15.126067 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-67cca170-5bc2-4531-9533-f5e64b9811ed service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=8c58f5e9-2554-475d-a254-a02b35fda51b&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1267426
Jun 01 12:42:15.135634 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:15.206591 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-244542999-network', 'tenant_id': '5a84a76793e14c6f80e91f0ce9a6e26e'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:42:15.211351 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:42:15.215441 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Usage tracker for resource:network and tenant:5a84a76793e14c6f80e91f0ce9a6e26e is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:42:15.218169 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-50cb51aa-2d1c-4325-a05a-e2aebecafa4e req-dcfd9b2b-69fc-4ece-b59c-caeed0532039 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1094701
Jun 01 12:42:15.218301 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:42:15.224990 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:42:15.245555 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Made reservation on behalf of 5a84a76793e14c6f80e91f0ce9a6e26e for: {'network': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:42:15.247873 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.260105 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.275066 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:42:15.280622 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Usage tracker for resource:security_group_rule and tenant:5a84a76793e14c6f80e91f0ce9a6e26e is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:42:15.282034 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-e7779156-fe66-48f1-9a92-6701a411389c service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1463566
Jun 01 12:42:15.284212 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:42:15.290130 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:42:15.380462 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.384804 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.388941 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ca4767f1-0e79-47fd-902b-f6b9b36ed3fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:15.413400 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] vlan segment allocate from pool success with {'vlan_id': 754, 'physical_network': 'physnet1'}  {{(pid=91978) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:42:15.426737 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:15.428313 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.430788 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:15.431717 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.432073 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.db.segments_db [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Added segment 0639fdd3-7524-43ac-8e87-bab2babae079 of type vlan for network 1308baa5-7150-4a84-ac5f-c2c161212d06
Jun 01 12:42:15.438064 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a0e599f-7f68-4c73-9951-ced2ec740426 req-aff1d5c5-fefa-414f-b2e7-26f00929d2be service neutron] 10.222.0.95 "GET /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1473694
Jun 01 12:42:15.459051 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.489190 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.490467 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:15.491075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.493511 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25d1d6d0>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:17Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:15.495828 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:15.497662 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d9def7c-ee19-45b1-bb52-555b8f2e389e None None] The sync data for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi is: [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:37:10Z', 'revision_number': 4, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0230aa64-ede6-4ece-9f90-6a3969943e98', 'name': '', 'network_id': '8c58f5e9-2554-475d-a254-a02b35fda51b', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'mac_address': 'fa:16:3e:4c:8a:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:09Z', 'updated_at': '2021-06-01T12:37:17Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'subnets': [{'id': '167cc367-6630-45a8-93ac-09106b9e41f1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:42:15.596034 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 886 time: 0.5055346
Jun 01 12:42:15.598924 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35440) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:15.599431 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Pushing event updated for resources: {'Network': ['ID=1308baa5-7150-4a84-ac5f-c2c161212d06,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:15.602280 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:15.605343 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Request body: {'subnet': {'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-244542999-subnet', 'tenant_id': '5a84a76793e14c6f80e91f0ce9a6e26e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:42:15.611124 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:42:15.617232 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 1308baa5-7150-4a84-ac5f-c2c161212d06 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:42:15.618493 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Usage tracker for resource:subnet and tenant:5a84a76793e14c6f80e91f0ce9a6e26e is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:42:15.621984 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:42:15.627822 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:42:15.643524 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Made reservation on behalf of 5a84a76793e14c6f80e91f0ce9a6e26e for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:42:15.645901 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2345690'] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:15.735465 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed115b5d-7d74-4825-918a-f98c2a6f2000 None None] New status for floating IP ec3f8f9f-443d-4cee-bb11-2ec992472a3a: DOWN {{(pid=91980) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:42:16.014575 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a85952-2ac6-46dd-bf7d-f999368ef302 req-8d77db7f-fc9c-4638-a851-47650b2cdce8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:16.017129 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-69a85952-2ac6-46dd-bf7d-f999368ef302 req-8d77db7f-fc9c-4638-a851-47650b2cdce8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0918601
Jun 01 12:42:16.062417 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-69a85952-2ac6-46dd-bf7d-f999368ef302 req-d6d3c724-32c8-4450-aa9e-221761e2e820 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404348
Jun 01 12:42:16.137722 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2610733', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2345676'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:16.142566 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:16.213600 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c3173bfc-9767-47db-882f-01b7eae76aff,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:16.216380 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:16.259915 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Checking segment: {'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:42:16.260952 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Network hostable DHCP agents. Network: 1308baa5-7150-4a84-ac5f-c2c161212d06, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:42:16.298216 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Network 1308baa5-7150-4a84-ac5f-c2c161212d06 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:42:16.312332 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 1308baa5-7150-4a84-ac5f-c2c161212d06) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:42:16.322435 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15525087-933b-4524-a16b-fb065871ab09 None None] Network 1308baa5-7150-4a84-ac5f-c2c161212d06 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:42:16.323531 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c084b53-b877-4941-82c8-7182fad61272 req-54d0d172-41b3-46cb-911f-91c9cac1f905 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:16.325063 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2c084b53-b877-4941-82c8-7182fad61272 req-54d0d172-41b3-46cb-911f-91c9cac1f905 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.95 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.1137879
Jun 01 12:42:16.330909 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:16.331480 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:16.446475 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-1f596915-32f7-45a8-b140-ef4f1a4d4374 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 0.8462241
Jun 01 12:42:16.517435 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a82abc81-b6b5-493e-a9aa-27a912522ccf None None] Network 1308baa5-7150-4a84-ac5f-c2c161212d06 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:42:16.543937 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64817ec9-f97d-41c6-a722-690598d3b6d2 req-c4c537f7-ff03-4d5c-bbba-d877c2baca91 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:16.545435 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-64817ec9-f97d-41c6-a722-690598d3b6d2 req-c4c537f7-ff03-4d5c-bbba-d877c2baca91 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 945 time: 0.1811264
Jun 01 12:42:16.578798 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Deleting port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:16.579144 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:16.684811 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-64817ec9-f97d-41c6-a722-690598d3b6d2 req-c0e9a96b-6264-4bcc-bb19-e1c2007d9c7f tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/security-groups?id=769d56f0-3abb-4565-bb76-1e82a3f776a4&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1325860
Jun 01 12:42:16.748733 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] For port db567b77-bbc1-4e8f-95eb-46817c3ec9d6, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:16.749090 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:16.874073 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Calling delete_port for db567b77-bbc1-4e8f-95eb-46817c3ec9d6 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:16.991634 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:16.997097 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-93b79600-2cd5-4eff-bb92-9610a894ac51 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:17.044793 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event deleted for resources: {'Port': ['ID=db567b77-bbc1-4e8f-95eb-46817c3ec9d6,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:17.071040 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:17.154015 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] No DVR routers for this DVR port db567b77-bbc1-4e8f-95eb-46817c3ec9d6 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:42:17.156753 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:17.159558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-deleted', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:17.161835 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3bda7e9b-d1f2-4b21-a1a4-8b94d9639895" -d '{"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-deleted", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:17.182941 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2c084b53-b877-4941-82c8-7182fad61272 req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.95 "DELETE /v2.0/ports/db567b77-bbc1-4e8f-95eb-46817c3ec9d6 HTTP/1.1" status: 204  len: 173 time: 0.8475974
Jun 01 12:42:17.212720 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-affd5bc9-085d-48f3-8941-9d3e90ab5e65 x-openstack-request-id: req-affd5bc9-085d-48f3-8941-9d3e90ab5e65 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:17.213044 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36fa4d47-2b8d-49da-be72-1ee15995dedf", "name": "network-vif-deleted", "tag": "db567b77-bbc1-4e8f-95eb-46817c3ec9d6", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:17.213930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-affd5bc9-085d-48f3-8941-9d3e90ab5e65 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:17.214364 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '36fa4d47-2b8d-49da-be72-1ee15995dedf', 'name': 'network-vif-deleted', 'tag': 'db567b77-bbc1-4e8f-95eb-46817c3ec9d6', 'status': 'completed', 'code': 200}
Jun 01 12:42:17.305385 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd92cfab-e4df-4949-a385-d075b56e61ad req-a01f7171-9d94-451b-ad6f-702df2274f71 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:17.306859 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bd92cfab-e4df-4949-a385-d075b56e61ad req-a01f7171-9d94-451b-ad6f-702df2274f71 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0988946
Jun 01 12:42:17.357175 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bd92cfab-e4df-4949-a385-d075b56e61ad req-11a534e2-6b64-4e65-bdcb-1aa325df4557 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445495
Jun 01 12:42:17.560748 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-0487058e-75ce-4caf-8b24-48125e9c4ffa tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-272221243&fields=id&tenant_id=892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 267 time: 0.0424790
Jun 01 12:42:17.711667 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-7b8a8ee6-6af0-40e7-9c5b-de28d67ed3f3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:17.713219 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-7b8a8ee6-6af0-40e7-9c5b-de28d67ed3f3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 812 time: 0.1458409
Jun 01 12:42:17.739500 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-cb68aafd-9872-4e57-9abf-88ae2bf5ab7f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/quotas/892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 375 time: 0.0178053
Jun 01 12:42:17.836074 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-f80e9818-3f9b-4da9-9d66-88b05658d602 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0887876
Jun 01 12:42:17.862205 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d07940f0-7062-4af9-93c6-7f9fd80c31a7 req-8cd67c3d-a361-495d-a311-b07b3cc14ff0 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "GET /v2.0/ports?device_id=36fa4d47-2b8d-49da-be72-1ee15995dedf HTTP/1.1" status: 200  len: 210 time: 0.0485241
Jun 01 12:42:17.977318 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-1cb50aa9-6845-4b2d-b54c-f0adf9f98af5 service neutron] 10.222.0.81 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1294839
Jun 01 12:42:18.196711 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-e388a062-b6b1-4201-aa20-9764e0a4df80 service neutron] 10.222.0.81 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2121310
Jun 01 12:42:18.614588 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-926496de-ad14-4b2a-9477-97bd3b1ebfe8 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:18.616221 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-926496de-ad14-4b2a-9477-97bd3b1ebfe8 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Synchronizing usage tracker for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:network {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:42:18.633686 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-926496de-ad14-4b2a-9477-97bd3b1ebfe8 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Unset dirty status for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:network {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:42:18.635213 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-926496de-ad14-4b2a-9477-97bd3b1ebfe8 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/networks?id=1308baa5-7150-4a84-ac5f-c2c161212d06 HTTP/1.1" status: 200  len: 813 time: 0.2783840
Jun 01 12:42:18.653125 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0f41b51d-95bc-4bdb-af89-2bbe6415d181 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/quotas/5a84a76793e14c6f80e91f0ce9a6e26e HTTP/1.1" status: 200  len: 375 time: 0.0105734
Jun 01 12:42:18.698602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d1a0ed-5602-4d32-a4ec-b65b30512f94 req-2879086d-f0df-4a21-87f7-a4f661119350 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:18.700332 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-60d1a0ed-5602-4d32-a4ec-b65b30512f94 req-2879086d-f0df-4a21-87f7-a4f661119350 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0844424
Jun 01 12:42:18.705801 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-9c50fb6d-2d0b-4bd6-aa58-b2f532b3ed68 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=5a84a76793e14c6f80e91f0ce9a6e26e&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0466568
Jun 01 12:42:18.756311 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-60d1a0ed-5602-4d32-a4ec-b65b30512f94 req-32d946b1-aed3-46e0-8468-468fb09bd2ed tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0489876
Jun 01 12:42:18.787646 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device db567b77-bbc1-4e8f-95eb-46817c3ec9d6 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:18.827547 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: db567b77-bbc1-4e8f-95eb-46817c3ec9d6 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:42:18.828040 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device db567b77-bbc1-4e8f-95eb-46817c3ec9d6 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:42:18.864772 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c80a78db-10fe-4edb-85ce-2ac41ce6905e req-8a4f6c06-9205-442c-8160-0af4d501c9a7 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 210 time: 0.0575464
Jun 01 12:42:18.921760 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-6437feee-b5b5-4c13-b9f8-4b7eb7761599 service neutron] 10.222.0.81 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2091517
Jun 01 12:42:18.967309 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35512) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:19.040032 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:19.062511 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-03fbdf67-817a-4fe4-8256-7ddc37407ec9 service neutron] 10.222.0.81 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1327517
Jun 01 12:42:19.071817 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:19.153563 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:19.158811 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-dbc10353-5315-4502-bbae-aa46a1ab7728 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:19.177747 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=769d56f0-3abb-4565-bb76-1e82a3f776a4,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:19.181014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:19.256042 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:19.257150 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] 10.222.0.81 "DELETE /v2.0/security-groups/769d56f0-3abb-4565-bb76-1e82a3f776a4 HTTP/1.1" status: 204  len: 168 time: 0.2886569
Jun 01 12:42:19.265399 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d6cffaf1-cceb-40ec-911a-ff6aed48c640 req-bc1629ba-4141-4903-8d70-9c7ed01a157d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 210 time: 0.0593810
Jun 01 12:42:19.305924 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35524) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:19.716629 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-f0984f88-4cf4-4581-adfd-b88ba20bcfcc tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:19.718383 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-f0984f88-4cf4-4581-adfd-b88ba20bcfcc tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 812 time: 0.1688251
Jun 01 12:42:19.788935 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-4455c87e-9ba9-436e-a72d-a5bc109b0590 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=892af7572bdb454483d1279dcfc9ccb0 HTTP/1.1" status: 200  len: 379 time: 0.0533271
Jun 01 12:42:19.805829 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'port': {'device_id': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'admin_state_up': True, 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'security_groups': ['886adde4-fecb-48e7-a65d-8c4b1eef5d0e']}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:42:19.969475 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:20.050607 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:42:20.062189 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f70e473-21e2-4031-a907-fd617139793e req-6e8e6e9e-73a2-422f-9071-7f0d91d0090e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:20.063653 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8f70e473-21e2-4031-a907-fd617139793e req-6e8e6e9e-73a2-422f-9071-7f0d91d0090e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1571000
Jun 01 12:42:20.072030 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:42:20.082916 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8ed7c6b7-159f-4288-9971-002ca1222ec9 req-a76ce69f-f834-4615-8281-3559d00aa3a1 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 210 time: 0.0612290
Jun 01 12:42:20.115317 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Made reservation on behalf of 892af7572bdb454483d1279dcfc9ccb0 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:42:20.119296 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:20.165572 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8f70e473-21e2-4031-a907-fd617139793e req-de8c19a1-5067-4be7-a814-b47960676a57 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0864944
Jun 01 12:42:20.335815 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Allocated IP 172.20.0.4 (42f63911-56d5-4572-8431-a99e560ca482/056def2a-a8b2-4665-b4ba-cc9e031e8b58/f134ab33-87e8-442b-8165-d6bba1a217db) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:42:20.562152 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:20.584572 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Transition to ACTIVE for port object f134ab33-87e8-442b-8165-d6bba1a217db will not be triggered until provisioned by entity DHCP. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:42:20.611910 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:20.617874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fd2cbb7b-9ca5-44ce-8807-ee7e5f2e9b8d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:20.631419 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-015e2396-19c6-4382-ba61-e910175d33ab req-c3f5b0fa-2174-4d62-9d6f-a31824d4080a tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 210 time: 0.1936786
Jun 01 12:42:20.685895 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Network 42f63911-56d5-4572-8431-a99e560ca482 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:42:20.689070 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:42:20.693267 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:42:20.732102 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-367bffb5-1277-467a-be17-5783bb4ef8f2 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:20.733573 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-367bffb5-1277-467a-be17-5783bb4ef8f2 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "GET /v2.0/networks?id=1308baa5-7150-4a84-ac5f-c2c161212d06 HTTP/1.1" status: 200  len: 813 time: 0.4566169
Jun 01 12:42:20.744180 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=f134ab33-87e8-442b-8165-d6bba1a217db,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:20.748598 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Request body: {'port': {'device_id': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06', 'admin_state_up': True, 'tenant_id': '5a84a76793e14c6f80e91f0ce9a6e26e'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:42:20.749237 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:20.765031 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:20.766225 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:20.792264 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9922440
Jun 01 12:42:20.803748 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Request body: {'port': {'device_id': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:42:20.920197 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:20.942528 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:42:20.947244 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Deleting port 0230aa64-ede6-4ece-9f90-6a3969943e98 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:20.947634 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:20.960434 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Usage tracker for resource:port and tenant:5a84a76793e14c6f80e91f0ce9a6e26e is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:42:20.965372 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:42:20.969816 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-13ee148d-0eb8-41fb-b5c6-d4c4f47ff4bd None None] Provisioning for port f134ab33-87e8-442b-8165-d6bba1a217db completed by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:42:20.975272 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-13ee148d-0eb8-41fb-b5c6-d4c4f47ff4bd None None] Provisioning complete for port f134ab33-87e8-442b-8165-d6bba1a217db triggered by entity DHCP. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:42:20.975671 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:42:20.976136 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-13ee148d-0eb8-41fb-b5c6-d4c4f47ff4bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.034590 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-13ee148d-0eb8-41fb-b5c6-d4c4f47ff4bd None None] Port f134ab33-87e8-442b-8165-d6bba1a217db cannot update to ACTIVE because it is not bound. {{(pid=91980) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
Jun 01 12:42:21.046589 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Made reservation on behalf of 5a84a76793e14c6f80e91f0ce9a6e26e for: {'port': 1} {{(pid=91978) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:42:21.049962 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.143932 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] For port 0230aa64-ede6-4ece-9f90-6a3969943e98, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=0230aa64-ede6-4ece-9f90-6a3969943e98,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:21.144290 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.291737 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Calling delete_port for 0230aa64-ede6-4ece-9f90-6a3969943e98 owned by network:router_interface {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:21.360018 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7589d4-7dd9-4dc7-9824-e72f193b9775 req-52909f3d-d42e-4a6c-aaae-c6997f06b8ed tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:21.360744 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-9f7589d4-7dd9-4dc7-9824-e72f193b9775 req-52909f3d-d42e-4a6c-aaae-c6997f06b8ed tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:42:21.423472 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-9f7589d4-7dd9-4dc7-9824-e72f193b9775 req-52909f3d-d42e-4a6c-aaae-c6997f06b8ed tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:42:21.424537 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9f7589d4-7dd9-4dc7-9824-e72f193b9775 req-52909f3d-d42e-4a6c-aaae-c6997f06b8ed tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 931 time: 0.1960225
Jun 01 12:42:21.446666 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_common [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Allocated IP 172.20.0.13 (1308baa5-7150-4a84-ac5f-c2c161212d06/c3173bfc-9767-47db-882f-01b7eae76aff/6633768a-79da-4774-b28b-ed453c345dfa) {{(pid=91978) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:42:21.456417 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f134ab33-87e8-442b-8165-d6bba1a217db {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:42:21.467210 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.475605 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08804404-cdb1-463d-b1d9-dbf0b2ffb730 req-b3251077-4eb0-4d01-b253-4cda55250cb8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:21.477106 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-08804404-cdb1-463d-b1d9-dbf0b2ffb730 req-b3251077-4eb0-4d01-b253-4cda55250cb8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1955857
Jun 01 12:42:21.499479 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Transition to ACTIVE for port object f134ab33-87e8-442b-8165-d6bba1a217db will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:42:21.503119 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9f7589d4-7dd9-4dc7-9824-e72f193b9775 req-65feacfc-2e30-4b95-856c-14136a3b7d86 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0704832
Jun 01 12:42:21.504255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.507994 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-0019a492-99e0-4fa0-b998-a2cbf771b59c tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:21.659461 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-08804404-cdb1-463d-b1d9-dbf0b2ffb730 req-712f0853-90cb-451e-a67b-cf5e976dd6fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1714857
Jun 01 12:42:21.660553 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Pushing event updated for resources: {'Port': ['ID=f134ab33-87e8-442b-8165-d6bba1a217db,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:21.669160 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:21.750873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Attempting to bind port f134ab33-87e8-442b-8165-d6bba1a217db on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:42:21.751203 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Attempting to bind port f134ab33-87e8-442b-8165-d6bba1a217db by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:42:21.751578 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Attempting to bind port f134ab33-87e8-442b-8165-d6bba1a217db on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:42:21.757038 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Port f134ab33-87e8-442b-8165-d6bba1a217db on network 42f63911-56d5-4572-8431-a99e560ca482 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:42:21.757225 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Attempting to bind port f134ab33-87e8-442b-8165-d6bba1a217db on network 42f63911-56d5-4572-8431-a99e560ca482 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:42:21.763122 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 42, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:42:21.763617 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Checking segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:42:21.764001 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Bound using segment: {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:42:21.764429 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Bound port: f134ab33-87e8-442b-8165-d6bba1a217db, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '12681f3e-56a4-4c14-a93e-9cd2b361c70d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 759, 'network_id': '42f63911-56d5-4572-8431-a99e560ca482'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:42:21.765255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.802887 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks [] for port, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.823720 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.829651 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-af6b2188-1b73-4d8c-8bf2-f60353439754 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:21.873853 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-365884ad-c1e9-4056-a61a-69e7fa33dd4c req-712491b5-d4cb-4f7e-8f34-43492fd10e14 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 210 time: 0.0919220
Jun 01 12:42:21.880417 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Pushing event deleted for resources: {'Port': ['ID=0230aa64-ede6-4ece-9f90-6a3969943e98,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:21.883468 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:21.931114 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] For port f134ab33-87e8-442b-8165-d6bba1a217db, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:42:21.934753 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] For port f134ab33-87e8-442b-8165-d6bba1a217db, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=f134ab33-87e8-442b-8165-d6bba1a217db,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:42:21.940567 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:21.944811 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-5109f848-7d44-41aa-ae9e-de31adf34068 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:21.979800 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:22.006805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:22.007384 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:22.008783 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] 10.222.0.95 "PUT /v2.0/ports/f134ab33-87e8-442b-8165-d6bba1a217db HTTP/1.1" status: 200  len: 1093 time: 1.2093463
Jun 01 12:42:22.009303 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:22.012124 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b" -d '{"events": [{"name": "network-changed", "server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:22.042939 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Pushing event updated for resources: {'Port': ['ID=f134ab33-87e8-442b-8165-d6bba1a217db,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:22.048153 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b2b83fc7-8c03-4a5e-89a7-60631f767bdd tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:22.054471 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:22.101135 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5ced539-be30-4513-909b-f2c7aa0cc650 x-openstack-request-id: req-d5ced539-be30-4513-909b-f2c7aa0cc650 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:22.101942 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:22.102383 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-d5ced539-be30-4513-909b-f2c7aa0cc650 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:22.103440 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'status': 'completed', 'code': 200}
Jun 01 12:42:22.147904 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Network 1308baa5-7150-4a84-ac5f-c2c161212d06 is already hosted by enough agents. {{(pid=91978) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:42:22.153131 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.base_scheduler [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Resources bound (agent type, host, resource id):  {{(pid=91978) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:42:22.167836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-c7d122d4-194b-4610-bb90-8d72d96f44d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:22.169994 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-c7d122d4-194b-4610-bb90-8d72d96f44d0 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 1096 time: 0.1105413
Jun 01 12:42:22.208172 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Received port after_create {{(pid=91978) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:42:22.253835 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-dcf69df6-9bc7-47d2-a82c-bdbb491b832d service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f134ab33-87e8-442b-8165-d6bba1a217db HTTP/1.1" status: 200  len: 217 time: 0.0761814
Jun 01 12:42:22.323014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-c683f19a-286c-4b19-b795-15993e8a2b60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:22.324631 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-c683f19a-286c-4b19-b795-15993e8a2b60 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0646949
Jun 01 12:42:22.381238 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Pushing event updated for resources: {'Port': ['ID=6633768a-79da-4774-b28b-ed453c345dfa,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:22.392737 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.345s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:22.406676 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-4bd55e75-10aa-439d-adb8-88b7b3ad4e08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:22.408140 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-4bd55e75-10aa-439d-adb8-88b7b3ad4e08 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0773249
Jun 01 12:42:22.428100 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:22.428727 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:22.432382 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:22.528529 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-0d015707-b05f-4688-98fa-cc70199f872e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.7854314
Jun 01 12:42:22.542434 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.v2.base [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Request body: {'port': {'device_id': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91978) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:42:22.546979 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-380ae3ae-9670-4f4f-8743-05119a42d112 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1320977
Jun 01 12:42:22.740044 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cc467f21-a194-48ad-b29b-972fa4ffc9f8 req-65db0aad-bd4c-4cee-93e0-6f392b22d253 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1871850
Jun 01 12:42:22.764019 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57aead5b-a019-4ced-8de6-c5806bb0018e req-f9508370-312c-4976-a9bd-057e454142db tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:22.765714 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57aead5b-a019-4ced-8de6-c5806bb0018e req-f9508370-312c-4976-a9bd-057e454142db tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 943 time: 0.1425080
Jun 01 12:42:22.809353 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:22.873249 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57aead5b-a019-4ced-8de6-c5806bb0018e req-02ef3a9d-26be-478c-b257-8d30f5e795a9 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1005235
Jun 01 12:42:22.892771 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-3f84f673-568e-44ce-9630-793e83c13574 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:22.894213 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-3f84f673-568e-44ce-9630-793e83c13574 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 1096 time: 0.1013272
Jun 01 12:42:23.090045 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Router 25520016-154b-4bde-8e0c-2e8576327298 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:42:23.178591 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-7771463c-a6f3-43ad-be74-df04d22f9e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:23.180046 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-7771463c-a6f3-43ad-be74-df04d22f9e71 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.2787983
Jun 01 12:42:23.204890 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0936641-e87f-46b1-a62d-96cefbc03329 req-1642580e-c015-49e1-835d-ed36f1f65335 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:23.206351 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0936641-e87f-46b1-a62d-96cefbc03329 req-1642580e-c015-49e1-835d-ed36f1f65335 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.3852785
Jun 01 12:42:23.252916 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8930f254-dd28-4fe4-9b9e-edd426d1d987 req-a76a70f0-c4f8-46cd-b526-3dd370a036c7 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:23.254349 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8930f254-dd28-4fe4-9b9e-edd426d1d987 req-a76a70f0-c4f8-46cd-b526-3dd370a036c7 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 932 time: 0.1866059
Jun 01 12:42:23.263182 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-ac82e9fc-fe76-4748-828f-37d7a2f3d7dd service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f134ab33-87e8-442b-8165-d6bba1a217db HTTP/1.1" status: 200  len: 217 time: 0.0720139
Jun 01 12:42:23.348565 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8930f254-dd28-4fe4-9b9e-edd426d1d987 req-8b935cb9-857b-413a-89d3-af5b1dcfb70a tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0867519
Jun 01 12:42:23.356319 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-8a6776a7-6192-4090-836d-3c927320d000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:23.357632 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-8a6776a7-6192-4090-836d-3c927320d000 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0822904
Jun 01 12:42:23.402239 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0936641-e87f-46b1-a62d-96cefbc03329 req-75d8286c-0ff4-488e-bc8e-e032b02d97b5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1422338
Jun 01 12:42:23.434684 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-790bd37a-564f-438f-982a-ebcc6fd22f3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:23.436359 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-790bd37a-564f-438f-982a-ebcc6fd22f3f service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0724826
Jun 01 12:42:23.452323 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:42:23.457557 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-8fffe71b-4b0d-42ff-8030-dc9f08002088 admin admin] 10.222.0.81 "PUT /v2.0/routers/25520016-154b-4bde-8e0c-2e8576327298/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 4.1505113
Jun 01 12:42:23.462842 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] Sync routers for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:42:23.465401 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35558) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:23.472048 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:23.473012 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25ed3d60>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:23.529328 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6633768a-79da-4774-b28b-ed453c345dfa {{(pid=91978) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:42:23.536990 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Notify callbacks [] for port, precommit_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:23.551974 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.provisioning_blocks [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Transition to ACTIVE for port object 6633768a-79da-4774-b28b-ed453c345dfa will not be triggered until provisioned by entity L2. {{(pid=91978) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:42:23.556495 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:23.570075 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-172a190c-417f-48bf-bbfe-451105dc62a8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:23.660534 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:23.728201 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-7dc75801-f8cd-45dd-9ee6-ccfaa8598da6 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2853343
Jun 01 12:42:23.730937 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Pushing event updated for resources: {'Port': ['ID=6633768a-79da-4774-b28b-ed453c345dfa,revision_number=2']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:23.735451 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks [] for router, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:23.758884 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:23.804356 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.managers [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Attempting to bind port 6633768a-79da-4774-b28b-ed453c345dfa on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:42:23.804728 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.managers [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Attempting to bind port 6633768a-79da-4774-b28b-ed453c345dfa by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'}] {{(pid=91978) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:42:23.805042 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Attempting to bind port 6633768a-79da-4774-b28b-ed453c345dfa on network 1308baa5-7150-4a84-ac5f-c2c161212d06 {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:42:23.810698 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Port 6633768a-79da-4774-b28b-ed453c345dfa on network 1308baa5-7150-4a84-ac5f-c2c161212d06 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:42:23.811035 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Attempting to bind port 6633768a-79da-4774-b28b-ed453c345dfa on network 1308baa5-7150-4a84-ac5f-c2c161212d06 {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:42:23.816915 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 42, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:42:23.817776 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Checking segment: {'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91978) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:42:23.817776 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Bound using segment: {'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'} {{(pid=91978) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:42:23.818090 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.managers [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Bound port: 6633768a-79da-4774-b28b-ed453c345dfa, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'}}] {{(pid=91978) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:42:23.818381 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:23.961995 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25ed3d60>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:42:21Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:23.966434 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] Checking router: 25520016-154b-4bde-8e0c-2e8576327298 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:42:23.976680 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] Routers {'25520016-154b-4bde-8e0c-2e8576327298'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:23.977309 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25ed3d60>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['25520016-154b-4bde-8e0c-2e8576327298'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:24.065802 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] For port 6633768a-79da-4774-b28b-ed453c345dfa, host hv-cinder-79351, cleared binding levels {{(pid=91978) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:42:24.068889 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d0dd9a94-7107-4980-89af-6e8bcfbcc87b req-e6c850b3-5d6e-4180-af80-811c6653052b service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2841451
Jun 01 12:42:24.069029 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] For port 6633768a-79da-4774-b28b-ed453c345dfa, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=6633768a-79da-4774-b28b-ed453c345dfa,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91978) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:42:24.075329 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2521952'] for port, after_update {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:24.079425 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e836cad2-fb05-4a30-b5bb-1adced989a18 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:24.079981 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:24.141983 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:24.142618 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:24.144072 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] 10.222.0.95 "PUT /v2.0/ports/6633768a-79da-4774-b28b-ed453c345dfa HTTP/1.1" status: 200  len: 1094 time: 1.6080525
Jun 01 12:42:24.147164 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'tag': '6633768a-79da-4774-b28b-ed453c345dfa'}] {{(pid=91978) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:24.150336 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08332f069cdff5b13479b061d6bbe376049db186f7bff4c04e61a4b86035db55" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8" -d '{"events": [{"name": "network-changed", "server_uuid": "74b314d5-d1f6-4c22-8124-289e77ae54c3", "tag": "6633768a-79da-4774-b28b-ed453c345dfa"}]}' {{(pid=91978) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:24.170720 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Pushing event updated for resources: {'Port': ['ID=6633768a-79da-4774-b28b-ed453c345dfa,revision_number=3']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:24.173054 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] Set router 25520016-154b-4bde-8e0c-2e8576327298 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:24.174521 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:24.179339 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44e597b-2234-403f-a5ca-bbaa1ce5695e req-fd4d4f00-893a-4826-a80e-c3484407fce5 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:24.186829 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b44e597b-2234-403f-a5ca-bbaa1ce5695e req-fd4d4f00-893a-4826-a80e-c3484407fce5 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 943 time: 0.1956992
Jun 01 12:42:24.223314 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Deleting port 169a556b-064c-4cad-bb81-cab53dcd949f {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:24.223666 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:24.255068 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e65079c9-aae7-4502-a999-fbdcdc2aa7ff x-openstack-request-id: req-e65079c9-aae7-4502-a999-fbdcdc2aa7ff {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:24.255397 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "74b314d5-d1f6-4c22-8124-289e77ae54c3", "tag": "6633768a-79da-4774-b28b-ed453c345dfa", "status": "completed", "code": 200}]} {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:24.255690 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-e65079c9-aae7-4502-a999-fbdcdc2aa7ff {{(pid=91978) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:24.256111 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'tag': '6633768a-79da-4774-b28b-ed453c345dfa', 'status': 'completed', 'code': 200}
Jun 01 12:42:24.290425 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-7cf72e43-3a36-42b4-aa16-504aedef3a25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:24.292497 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-7cf72e43-3a36-42b4-aa16-504aedef3a25 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5a84a76793e14c6f80e91f0ce9a6e26e&device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 1097 time: 0.0780683
Jun 01 12:42:24.314287 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b44e597b-2234-403f-a5ca-bbaa1ce5695e req-2a979bc5-fed1-4dc7-ac47-a35b924578d8 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1265936
Jun 01 12:42:24.366342 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-b1a87198-088b-4527-806c-4a18ab9a79f4 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6633768a-79da-4774-b28b-ed453c345dfa HTTP/1.1" status: 200  len: 217 time: 0.0663216
Jun 01 12:42:24.368451 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] For port 169a556b-064c-4cad-bb81-cab53dcd949f, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=169a556b-064c-4cad-bb81-cab53dcd949f,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:24.368829 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:24.449702 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-4f5f853c-80c1-4704-bbd3-5caff020a6e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:24.451840 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-4f5f853c-80c1-4704-bbd3-5caff020a6e0 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=c3173bfc-9767-47db-882f-01b7eae76aff HTTP/1.1" status: 200  len: 853 time: 0.0775619
Jun 01 12:42:24.538652 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25ed3d60>, [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:42:21Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:24.544061 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b2297df-8b90-484d-aaeb-91da534fcf94 None None] The sync data for ids ['25520016-154b-4bde-8e0c-2e8576327298'] in dv-cinder-793515-2-iscsi is: [{'id': '25520016-154b-4bde-8e0c-2e8576327298', 'name': 'tempest-TestShelveInstance-4979451-router', 'tenant_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106'}], 'enable_snat': True}, 'gw_port_id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:04Z', 'updated_at': '2021-06-01T12:42:21Z', 'revision_number': 5, 'project_id': 'a4d9bab00fe345e0b899bc42ea4416e0', 'gw_port': {'id': '169a556b-064c-4cad-bb81-cab53dcd949f', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:32:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25520016-154b-4bde-8e0c-2e8576327298', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:06Z', 'updated_at': '2021-06-01T12:37:11Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:42:24.551112 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-44ff5f76-d77c-4ffa-ba34-93bd588789e6 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=1308baa5-7150-4a84-ac5f-c2c161212d06&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0910780
Jun 01 12:42:24.633313 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Calling delete_port for 169a556b-064c-4cad-bb81-cab53dcd949f owned by network:router_gateway {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:24.715287 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85842aac-a8c8-4f6a-91bb-8b7ad7133f8b req-cddcebb0-5199-4ad9-9893-4bd7f7a99250 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:24.715974 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-85842aac-a8c8-4f6a-91bb-8b7ad7133f8b req-cddcebb0-5199-4ad9-9893-4bd7f7a99250 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Synchronizing usage tracker for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:42:24.726360 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-6dc1ce1b-0f31-4f5e-bf55-c10948a401b0 service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1622796
Jun 01 12:42:24.735434 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31f9180-edce-4e48-92bb-5e96803de172 req-569a5087-991d-4030-b571-40e7823bcf58 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:24.736927 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b31f9180-edce-4e48-92bb-5e96803de172 req-569a5087-991d-4030-b571-40e7823bcf58 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1110363
Jun 01 12:42:24.762143 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-85842aac-a8c8-4f6a-91bb-8b7ad7133f8b req-cddcebb0-5199-4ad9-9893-4bd7f7a99250 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Unset dirty status for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:42:24.763570 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85842aac-a8c8-4f6a-91bb-8b7ad7133f8b req-cddcebb0-5199-4ad9-9893-4bd7f7a99250 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 944 time: 0.2631781
Jun 01 12:42:24.869950 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-85842aac-a8c8-4f6a-91bb-8b7ad7133f8b req-c9a68e92-6b74-4659-a19c-455cd6daa246 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Synchronizing usage tracker for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:security_group {{(pid=91978) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:42:24.914454 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d0749725-a160-408a-a9b2-2989c37e5ec4 req-cfc6e99b-b6a1-4152-bb69-552d6bf9937e service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1801724
Jun 01 12:42:24.915685 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [req-85842aac-a8c8-4f6a-91bb-8b7ad7133f8b req-c9a68e92-6b74-4659-a19c-455cd6daa246 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Unset dirty status for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:security_group {{(pid=91978) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:42:24.916968 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85842aac-a8c8-4f6a-91bb-8b7ad7133f8b req-c9a68e92-6b74-4659-a19c-455cd6daa246 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1046767
Jun 01 12:42:24.933359 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b31f9180-edce-4e48-92bb-5e96803de172 req-05d1baa2-0060-4d0e-8c3d-21c061d20b44 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0808518
Jun 01 12:42:25.025363 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.032394 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:25.046770 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-f83f753a-fd83-49a2-b30d-77f0a03fe164 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:25.048429 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-f83f753a-fd83-49a2-b30d-77f0a03fe164 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5a84a76793e14c6f80e91f0ce9a6e26e&device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 1097 time: 0.0812967
Jun 01 12:42:25.087092 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Pushing event deleted for resources: {'Port': ['ID=169a556b-064c-4cad-bb81-cab53dcd949f,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:25.112878 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:25.177294 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.187760 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-936c91e7-bcae-41df-b2b9-4e05603bad4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:25.189244 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-936c91e7-bcae-41df-b2b9-4e05603bad4a service neutron] 10.222.0.95 "GET /v2.0/networks?id=1308baa5-7150-4a84-ac5f-c2c161212d06 HTTP/1.1" status: 200  len: 914 time: 0.1313429
Jun 01 12:42:25.257095 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-f456cc9f-8638-4eae-9cfc-73a274b18bbc service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6633768a-79da-4774-b28b-ed453c345dfa HTTP/1.1" status: 200  len: 217 time: 0.0579579
Jun 01 12:42:25.320776 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-d6e0935e-573b-4aa5-950b-1ffd1ce545cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:25.322195 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-d6e0935e-573b-4aa5-950b-1ffd1ce545cc service neutron] 10.222.0.95 "GET /v2.0/subnets?id=c3173bfc-9767-47db-882f-01b7eae76aff HTTP/1.1" status: 200  len: 853 time: 0.0586984
Jun 01 12:42:25.351945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.355348 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.371559 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-115d5b81-a70e-4021-920b-1161dc29c2dc service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=1308baa5-7150-4a84-ac5f-c2c161212d06&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0423059
Jun 01 12:42:25.465182 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.465706 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 25520016-154b-4bde-8e0c-2e8576327298 {{(pid=91979) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:42:25.480064 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Notify callbacks [] for router, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.481414 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] 10.222.0.81 "DELETE /v2.0/routers/25520016-154b-4bde-8e0c-2e8576327298 HTTP/1.1" status: 204  len: 168 time: 2.0148714
Jun 01 12:42:25.484087 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35572) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:25.527236 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-c2d3ee6b-5988-4c42-85e9-82e85df685f3 service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1468363
Jun 01 12:42:25.550304 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_v2 [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Deleting subnet 167cc367-6630-45a8-93ac-09106b9e41f1 {{(pid=91979) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:42:25.558036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.615006 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2204557'] for subnet, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.726569 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-66fbdfd3-b072-441f-bb89-09fa9b7c98e8 req-7f106362-3030-491f-a47c-578944ac5bb7 service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1917181
Jun 01 12:42:25.738947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:25.744059 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb62cfd-4dab-4ff3-9507-cccd33a2e9ee req-5aa21ef0-0c83-43f8-8a6e-3ae92707f59b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:25.746136 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4eb62cfd-4dab-4ff3-9507-cccd33a2e9ee req-5aa21ef0-0c83-43f8-8a6e-3ae92707f59b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 943 time: 0.1334057
Jun 01 12:42:25.891623 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4eb62cfd-4dab-4ff3-9507-cccd33a2e9ee req-3fe5daf8-50ef-4c4d-80d8-841b920c6cd9 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1395047
Jun 01 12:42:25.998518 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2610798', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2345669'] for subnet, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.003680 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:26.043693 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.046959 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=167cc367-6630-45a8-93ac-09106b9e41f1,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:26.048927 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a12d7edd-571d-430d-b215-293524e469e4 None None] Network 8c58f5e9-2554-475d-a254-a02b35fda51b requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:42:26.049454 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:26.160496 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93bd9f84-58a7-4ae9-a01f-f7938d4d10b2 req-51b88f9f-fdc1-4b2f-93c2-eca736a67194 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:26.162334 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-93bd9f84-58a7-4ae9-a01f-f7938d4d10b2 req-51b88f9f-fdc1-4b2f-93c2-eca736a67194 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0917318
Jun 01 12:42:26.194283 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-ab5a106c-7d0d-4d28-8dbb-25c7a8df1c17 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/167cc367-6630-45a8-93ac-09106b9e41f1 HTTP/1.1" status: 204  len: 168 time: 0.7089477
Jun 01 12:42:26.200546 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35580) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:26.245100 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-93bd9f84-58a7-4ae9-a01f-f7938d4d10b2 req-01de19d5-008d-44c4-8b47-693339241d0d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0755839
Jun 01 12:42:26.245269 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf0bbdd4-964e-4141-8bbb-b3cd5a91fa4e req-b3ae6862-68b7-456e-aba6-93d319401b4d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:26.250772 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 169a556b-064c-4cad-bb81-cab53dcd949f no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:26.252714 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cf0bbdd4-964e-4141-8bbb-b3cd5a91fa4e req-b3ae6862-68b7-456e-aba6-93d319401b4d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 944 time: 0.2008724
Jun 01 12:42:26.293604 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 169a556b-064c-4cad-bb81-cab53dcd949f {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:42:26.293916 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 169a556b-064c-4cad-bb81-cab53dcd949f not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:42:26.294394 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0230aa64-ede6-4ece-9f90-6a3969943e98 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:26.297582 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cf0bbdd4-964e-4141-8bbb-b3cd5a91fa4e req-1323eaca-c2a2-4c10-9783-48fb4b7ab06f tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439112
Jun 01 12:42:26.328788 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.330138 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 0230aa64-ede6-4ece-9f90-6a3969943e98 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:42:26.330487 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0230aa64-ede6-4ece-9f90-6a3969943e98 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:42:26.397306 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] DHCP port deletion for 8c58f5e9-2554-475d-a254-a02b35fda51b request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:42:26.406403 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Deleting port fb34a56f-1475-4049-8869-d08164f3f3b5 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:26.406672 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.465018 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Deleting port fb34a56f-1475-4049-8869-d08164f3f3b5 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:26.465395 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.508422 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] For port fb34a56f-1475-4049-8869-d08164f3f3b5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=fb34a56f-1475-4049-8869-d08164f3f3b5,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:26.508803 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.602521 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] For port fb34a56f-1475-4049-8869-d08164f3f3b5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=fb34a56f-1475-4049-8869-d08164f3f3b5,segment=NetworkSegment(cf66ca3e-849f-4c7a-ac26-44c6330098be),segment_id=cf66ca3e-849f-4c7a-ac26-44c6330098be)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:26.602908 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.631342 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Calling delete_port for fb34a56f-1475-4049-8869-d08164f3f3b5 owned by network:dhcp {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:26.675828 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.680835 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-322eb48e-5d7a-487e-95bb-0936cf100915 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:26.720974 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Calling delete_port for fb34a56f-1475-4049-8869-d08164f3f3b5 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:26.724612 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Pushing event deleted for resources: {'Port': ['ID=fb34a56f-1475-4049-8869-d08164f3f3b5,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:26.727563 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:26.728405 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] No DVR routers for this DVR port fb34a56f-1475-4049-8869-d08164f3f3b5 on host dv-cinder-793515-2-iscsi {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:42:26.767801 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.771317 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-f1c9f8e8-fa3f-4e41-a8c7-8b3b7bd1accd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:26.812959 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Pushing event deleted for resources: {'Port': ['ID=fb34a56f-1475-4049-8869-d08164f3f3b5,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:26.817840 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] No DVR routers for this DVR port fb34a56f-1475-4049-8869-d08164f3f3b5 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:42:26.824325 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.824703 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.825037 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.825361 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.825854 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.826345 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.826807 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.827524 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.828023 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.828544 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.829044 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.829370 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:26.832350 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:26.838433 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 6633768a-79da-4774-b28b-ed453c345dfa details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:42:26.848043 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.865540 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a256b1f70>,) {'filters': {'network_id': ['8c58f5e9-2554-475d-a254-a02b35fda51b']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:26.881205 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a256b1f70>, 'cf66ca3e-849f-4c7a-ac26-44c6330098be') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:26.881496 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a256b1f70>, 'cf66ca3e-849f-4c7a-ac26-44c6330098be') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:26.893664 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.909389 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.917576 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Releasing vlan 792 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:42:26.917998 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:42:26.933160 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:42:26.987315 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 6633768a-79da-4774-b28b-ed453c345dfa, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=6633768a-79da-4774-b28b-ed453c345dfa,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:27.000839 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '6633768a-79da-4774-b28b-ed453c345dfa', 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06', 'port_id': '6633768a-79da-4774-b28b-ed453c345dfa', 'mac_address': 'fa:16:3e:07:e7:e7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 754, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c3173bfc-9767-47db-882f-01b7eae76aff', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:42:27.063752 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:27.067753 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:27.076987 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-55818659-284b-4941-a8a2-c2dec9a69fae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:27.086126 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6633768a-79da-4774-b28b-ed453c345dfa {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:42:27.092483 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:27.103356 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 6633768a-79da-4774-b28b-ed453c345dfa, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=6633768a-79da-4774-b28b-ed453c345dfa,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:27.105763 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Pushing event deleted for resources: {'Network': ['ID=8c58f5e9-2554-475d-a254-a02b35fda51b,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:27.108551 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:27.109660 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:42:27.111023 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:27.113429 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:27.114161 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-4c2ba4fc-cf84-4f7f-9097-c4a7ab7272f1 admin admin] 10.222.0.81 "DELETE /v2.0/networks/8c58f5e9-2554-475d-a254-a02b35fda51b HTTP/1.1" status: 204  len: 168 time: 0.9130189
Jun 01 12:42:27.117362 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35586) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:27.147826 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68500d7e-5ab6-4356-aa41-b741b2ef98ca req-a4f30cdb-2287-403b-9253-8ec8bb438b41 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:27.149466 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-68500d7e-5ab6-4356-aa41-b741b2ef98ca req-a4f30cdb-2287-403b-9253-8ec8bb438b41 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 943 time: 0.1410892
Jun 01 12:42:27.210956 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-68500d7e-5ab6-4356-aa41-b741b2ef98ca req-24804549-ccf9-4676-8d91-99f68c64caf3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0509350
Jun 01 12:42:27.268701 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=6633768a-79da-4774-b28b-ed453c345dfa,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:27.271919 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:27.362385 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:27.379678 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'port_id': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'mac_address': 'fa:16:3e:54:1d:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 756, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:42:27.450671 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:27.472278 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 79b6ede7-bda5-4259-8b84-707dcd1fda2e {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:42:27.495341 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:27.500373 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:27.503058 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:27.528239 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54de5b0-1974-4d08-a81b-5d147ea83cb9 req-b206c4f2-0a7b-4d19-90ce-3c70e448d0a9 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:27.530065 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b54de5b0-1974-4d08-a81b-5d147ea83cb9 req-b206c4f2-0a7b-4d19-90ce-3c70e448d0a9 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 945 time: 0.0982964
Jun 01 12:42:27.585582 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=6']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:27.589639 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:27.596930 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['79b6ede7-bda5-4259-8b84-707dcd1fda2e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:42:27.610419 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b54de5b0-1974-4d08-a81b-5d147ea83cb9 req-85855362-1079-45f2-b074-e62380a90b62 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0728185
Jun 01 12:42:27.615441 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07dbb84e-652e-4363-a4df-818202d6b240 req-0fb9af05-9d78-4d11-b379-52398e7ed1d3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:27.616929 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-07dbb84e-652e-4363-a4df-818202d6b240 req-0fb9af05-9d78-4d11-b379-52398e7ed1d3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.2241166
Jun 01 12:42:27.745421 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-07dbb84e-652e-4363-a4df-818202d6b240 req-d9e87fb5-2b24-4041-ba8a-d04e4a6c683f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0987039
Jun 01 12:42:27.747435 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['6633768a-79da-4774-b28b-ed453c345dfa'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:42:27.869705 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:28.252044 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device fb34a56f-1475-4049-8869-d08164f3f3b5 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:28.319102 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: fb34a56f-1475-4049-8869-d08164f3f3b5 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:42:28.319600 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device fb34a56f-1475-4049-8869-d08164f3f3b5 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:42:28.415892 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8be7a68-6268-4e49-9b24-dde56d198626 req-fdb3376f-6cbe-452b-8737-a98769e84e60 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:28.423267 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Deleting port b9fd6587-f312-4bff-a7f2-8cf07e521378 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:28.423872 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:28.430148 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c8be7a68-6268-4e49-9b24-dde56d198626 req-fdb3376f-6cbe-452b-8737-a98769e84e60 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 943 time: 0.1067324
Jun 01 12:42:28.493069 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c8be7a68-6268-4e49-9b24-dde56d198626 req-8bca6dbb-8845-4bec-93aa-09875981ccbd tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0627420
Jun 01 12:42:28.595201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] For port b9fd6587-f312-4bff-a7f2-8cf07e521378, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=b9fd6587-f312-4bff-a7f2-8cf07e521378,segment=NetworkSegment(5d22763a-c728-4d3b-b291-ca264d604a65),segment_id=5d22763a-c728-4d3b-b291-ca264d604a65)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:28.595683 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:28.763714 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Calling delete_port for b9fd6587-f312-4bff-a7f2-8cf07e521378 owned by network:router_interface {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:28.838323 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 6633768a-79da-4774-b28b-ed453c345dfa up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:42:28.925018 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 6633768a-79da-4774-b28b-ed453c345dfa completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:42:28.935764 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 6633768a-79da-4774-b28b-ed453c345dfa triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:42:28.936368 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.020608 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf76409-57a4-4c6e-a816-cd361e327b4c req-bd82cd32-214e-4583-9137-8cdb9c28ad84 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:29.022214 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2bf76409-57a4-4c6e-a816-cd361e327b4c req-bd82cd32-214e-4583-9137-8cdb9c28ad84 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 944 time: 0.1253932
Jun 01 12:42:29.054585 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe097548-e563-441f-b79b-c0c8e5dda91a req-ee77b815-96fa-4734-bfbe-51fa8a1338c4 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:29.056331 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fe097548-e563-441f-b79b-c0c8e5dda91a req-ee77b815-96fa-4734-bfbe-51fa8a1338c4 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 945 time: 0.3043249
Jun 01 12:42:29.095697 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.105627 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-2bf76409-57a4-4c6e-a816-cd361e327b4c req-9fca0db5-77f9-4953-a90e-bb1a76dfa0de tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0690453
Jun 01 12:42:29.129104 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-fe097548-e563-441f-b79b-c0c8e5dda91a req-8a6f1b9f-d478-4a8a-968e-19c751b90ec1 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0630691
Jun 01 12:42:29.160856 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6633768a-79da-4774-b28b-ed453c345dfa'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:29.160856 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f300dd6f-2c86-4cb1-9428-2df68550722e" -d '{"events": [{"server_uuid": "74b314d5-d1f6-4c22-8124-289e77ae54c3", "name": "network-vif-plugged", "status": "completed", "tag": "6633768a-79da-4774-b28b-ed453c345dfa"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:29.185737 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 6633768a-79da-4774-b28b-ed453c345dfa, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=6633768a-79da-4774-b28b-ed453c345dfa,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:29.190833 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.192268 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:42:29.222401 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7f71c8e-31b5-4338-8187-e2740b8bbbcf x-openstack-request-id: req-b7f71c8e-31b5-4338-8187-e2740b8bbbcf {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:29.222908 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "74b314d5-d1f6-4c22-8124-289e77ae54c3", "name": "network-vif-plugged", "status": "completed", "tag": "6633768a-79da-4774-b28b-ed453c345dfa", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:29.223263 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-b7f71c8e-31b5-4338-8187-e2740b8bbbcf {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:29.223752 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6633768a-79da-4774-b28b-ed453c345dfa', 'code': 200}
Jun 01 12:42:29.224375 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-0ea2ccba-e14d-42ef-8cbf-1a3247aba0d8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:29.320318 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.334296 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:29.346987 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=6633768a-79da-4774-b28b-ed453c345dfa,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:29.350274 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:29.361141 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 79b6ede7-bda5-4259-8b84-707dcd1fda2e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:42:29.361141 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.412710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Pushing event deleted for resources: {'Port': ['ID=b9fd6587-f312-4bff-a7f2-8cf07e521378,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:29.419148 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:29.617762 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.667064 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dfd95ab-19cc-4a5e-bb24-d5757f282f03 req-b7f8977e-1ea6-46f4-a426-9394dab5a2cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:29.668831 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3dfd95ab-19cc-4a5e-bb24-d5757f282f03 req-b7f8977e-1ea6-46f4-a426-9394dab5a2cd service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 1099 time: 0.1773252
Jun 01 12:42:29.684831 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:29.696166 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.699660 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:29.742078 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-3dfd95ab-19cc-4a5e-bb24-d5757f282f03 req-8dcd24a7-0ce7-4d46-971a-00847e717164 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0656462
Jun 01 12:42:29.805293 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=7']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:29.808762 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:29.876777 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:42:29.877364 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:29.893674 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152b867c-d6a1-4f0d-9d49-7d91e35f1687 req-c5c0c529-7ac6-411f-8785-a4a8696c6a09 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:29.895285 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-152b867c-d6a1-4f0d-9d49-7d91e35f1687 req-c5c0c529-7ac6-411f-8785-a4a8696c6a09 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 943 time: 0.1861711
Jun 01 12:42:30.124113 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-152b867c-d6a1-4f0d-9d49-7d91e35f1687 req-dae75df0-98f4-4aaa-a162-9c2f8cc0bbc3 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1640959
Jun 01 12:42:30.384266 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48aa87f-964e-4b90-92d6-3909308d74b6 req-6442f227-41aa-419c-addd-8de6043e0aca tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:30.396655 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b48aa87f-964e-4b90-92d6-3909308d74b6 req-6442f227-41aa-419c-addd-8de6043e0aca tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1056948
Jun 01 12:42:30.452470 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b48aa87f-964e-4b90-92d6-3909308d74b6 req-2764b8b5-bd5a-404b-95d8-d095f392c166 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0540988
Jun 01 12:42:30.548588 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Router 50b97300-7fd3-46f7-943e-cf347dbb175e has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:42:30.664622 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3be4d372-d2a0-4ba5-99a6-b8af99882d41 req-722e509a-35d0-4546-a8ae-03484dee8408 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:30.666583 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3be4d372-d2a0-4ba5-99a6-b8af99882d41 req-722e509a-35d0-4546-a8ae-03484dee8408 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 946 time: 0.2167828
Jun 01 12:42:30.797258 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-3be4d372-d2a0-4ba5-99a6-b8af99882d41 req-0e468511-9859-4d5a-9635-9bfa50811320 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1218646
Jun 01 12:42:30.817672 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:42:30.841748 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] 10.222.0.81 "PUT /v2.0/routers/50b97300-7fd3-46f7-943e-cf347dbb175e/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.7206843
Jun 01 12:42:30.841927 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] Sync routers for ids ['50b97300-7fd3-46f7-943e-cf347dbb175e'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:42:30.842376 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35636) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:30.864200 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] Routers {'50b97300-7fd3-46f7-943e-cf347dbb175e'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:30.866120 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25081370>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['50b97300-7fd3-46f7-943e-cf347dbb175e'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:30.959127 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device f134ab33-87e8-442b-8165-d6bba1a217db details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:42:31.205572 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port f134ab33-87e8-442b-8165-d6bba1a217db, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=f134ab33-87e8-442b-8165-d6bba1a217db,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:31.217067 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks [] for router, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:31.220715 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] Set router 50b97300-7fd3-46f7-943e-cf347dbb175e gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:31.264159 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:31.266035 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7514d2dc-8067-4492-b6cd-4d80933b2703" -d '{"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-plugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:31.375298 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'port_id': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'mac_address': 'fa:16:3e:68:cf:1e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 759, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:42:31.421998 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-958d90c6-633e-425d-a2ab-3e501e9f3070 x-openstack-request-id: req-958d90c6-633e-425d-a2ab-3e501e9f3070 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:31.422301 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-plugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:31.422550 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-958d90c6-633e-425d-a2ab-3e501e9f3070 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:31.422937 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'code': 200}
Jun 01 12:42:31.517039 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:31.537766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f134ab33-87e8-442b-8165-d6bba1a217db {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:42:31.582091 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b708134-c6e4-48cb-b75f-b573983f1f71 req-42dce440-fa8c-46e6-8fab-14b65c10234c tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:31.583452 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4b708134-c6e4-48cb-b75f-b573983f1f71 req-42dce440-fa8c-46e6-8fab-14b65c10234c tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 943 time: 0.2434275
Jun 01 12:42:31.585922 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port f134ab33-87e8-442b-8165-d6bba1a217db, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=f134ab33-87e8-442b-8165-d6bba1a217db,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:31.616718 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:31.619651 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:31.624252 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-e60d2dd2-7891-4306-be81-70c7ce393425 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:31.649751 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-4b708134-c6e4-48cb-b75f-b573983f1f71 req-520d5c6d-f580-44a8-9ae7-dff73c1ce97c tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0578406
Jun 01 12:42:31.710068 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=f134ab33-87e8-442b-8165-d6bba1a217db,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:31.714177 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:31.724199 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25081370>, [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207'}], 'enable_snat': True}, 'gw_port_id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:42:29Z', 'revision_number': 5, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port': {'id': '3dcd55e7-e6e8-4791-8723-4a6e5142a7d5', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:76:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:37:15Z', 'updated_at': '2021-06-01T12:37:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:31.730474 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] Checking router: 50b97300-7fd3-46f7-943e-cf347dbb175e for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:42:31.738546 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Deleting port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:31.738968 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:31.739560 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] Routers {'50b97300-7fd3-46f7-943e-cf347dbb175e'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:31.740173 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25081370>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['50b97300-7fd3-46f7-943e-cf347dbb175e'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:31.802451 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5701093-492d-42a4-a1b5-d39002fc56a8 req-d1c2c361-2217-4390-80c2-563dc47497b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:31.803820 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b5701093-492d-42a4-a1b5-d39002fc56a8 req-d1c2c361-2217-4390-80c2-563dc47497b3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1307704
Jun 01 12:42:31.952647 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['f134ab33-87e8-442b-8165-d6bba1a217db'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:42:31.954684 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] For port 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:31.955162 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:32.031859 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b5701093-492d-42a4-a1b5-d39002fc56a8 req-1a15c640-fe75-4f98-8380-c00726f978e9 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2212303
Jun 01 12:42:32.072990 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] Set router 50b97300-7fd3-46f7-943e-cf347dbb175e gateway port host: None {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:32.172025 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Calling delete_port for 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 owned by network:router_gateway {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:32.229656 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25475fd8-1591-4fbf-95fc-823e414492df req-14832c89-d43b-4f90-bfdb-af8db918a06f tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:32.234774 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-25475fd8-1591-4fbf-95fc-823e414492df req-14832c89-d43b-4f90-bfdb-af8db918a06f tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 946 time: 0.2672086
Jun 01 12:42:32.274808 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25081370>, [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:42:31Z', 'revision_number': 6, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port_host': None}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:32.313158 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-25475fd8-1591-4fbf-95fc-823e414492df req-4720401d-3e3c-4d73-b119-e8cd944165dc tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0753818
Jun 01 12:42:32.318961 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3468f47e-5c69-4a1e-a526-c6bcbf29eccb None None] The sync data for ids ['50b97300-7fd3-46f7-943e-cf347dbb175e'] in dv-cinder-793515-2-iscsi is: [{'id': '50b97300-7fd3-46f7-943e-cf347dbb175e', 'name': 'tempest-TestShelveInstance-1025958974-router', 'tenant_id': '96abebccc0734fe388fae3749429552c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:37:14Z', 'updated_at': '2021-06-01T12:42:31Z', 'revision_number': 6, 'project_id': '96abebccc0734fe388fae3749429552c', 'gw_port_host': None}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:42:32.462752 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:32.474698 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5b352fcc-f3ab-4815-aa01-d603de7ad42f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:32.536361 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Pushing event deleted for resources: {'Port': ['ID=3dcd55e7-e6e8-4791-8723-4a6e5142a7d5,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:32.549717 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.550108 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.550482 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.550848 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.551261 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.551634 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.552153 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.552538 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.552934 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.553342 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.553701 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.554054 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:32.598019 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:32.688672 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:32.911954 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:32.914799 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:32.942999 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be7a22e8-2d3d-47a8-b18f-5e07ef16d389 req-a8e7083a-f844-485c-8a18-9b0e10192f8b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:32.944879 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-be7a22e8-2d3d-47a8-b18f-5e07ef16d389 req-a8e7083a-f844-485c-8a18-9b0e10192f8b tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 944 time: 0.1201539
Jun 01 12:42:32.960240 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:32.960974 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 50b97300-7fd3-46f7-943e-cf347dbb175e {{(pid=91978) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:42:32.982986 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:32.984258 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-37f3215b-e9b4-428f-aefc-b9bb668fc90f admin admin] 10.222.0.81 "DELETE /v2.0/routers/50b97300-7fd3-46f7-943e-cf347dbb175e HTTP/1.1" status: 204  len: 168 time: 2.1409118
Jun 01 12:42:32.987469 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35692) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:33.018109 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-be7a22e8-2d3d-47a8-b18f-5e07ef16d389 req-c655b357-6cc5-4d2f-873c-b08dcae0a9cf tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0636237
Jun 01 12:42:33.113898 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Deleting subnet 2e47d1b1-d844-4196-ad31-3dff92cabed9 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:42:33.132545 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:33.217743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:33.513625 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5861d167-06c9-4d88-9bb4-f24673e8e920 req-7102e477-b8f8-4f43-be94-28c6f03c5b5e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:33.515340 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5861d167-06c9-4d88-9bb4-f24673e8e920 req-7102e477-b8f8-4f43-be94-28c6f03c5b5e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.2585690
Jun 01 12:42:33.520492 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:33.633821 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5861d167-06c9-4d88-9bb4-f24673e8e920 req-8c9a8c96-3ef7-491b-8827-65cadcb1f7d9 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0808520
Jun 01 12:42:33.893651 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:33.904646 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9da4c3b6-559d-4aad-9f25-dd0f6d51ac61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:33.950053 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:33.955120 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20a44d6c-a3aa-487b-9c47-f790943bccd2 None None] Network c0bcf70c-dd52-4c1c-bdfb-801657b54172 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:42:33.964198 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2e47d1b1-d844-4196-ad31-3dff92cabed9,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:33.968770 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:33.982593 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d59d0b91-ed9a-45c9-875c-6e3068703d12 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/2e47d1b1-d844-4196-ad31-3dff92cabed9 HTTP/1.1" status: 204  len: 168 time: 0.9917166
Jun 01 12:42:33.983445 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35718) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:34.130828 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:34.258451 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:34.310165 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:42:34.310631 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3dcd55e7-e6e8-4791-8723-4a6e5142a7d5 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:42:34.311271 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device b9fd6587-f312-4bff-a7f2-8cf07e521378 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:34.342689 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0149807b-11c1-49ce-bd61-f942ea3e9378 req-12c10852-dd4e-4132-9f99-f19d3ccf4b16 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:34.345164 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0149807b-11c1-49ce-bd61-f942ea3e9378 req-12c10852-dd4e-4132-9f99-f19d3ccf4b16 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 944 time: 0.1817153
Jun 01 12:42:34.346763 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Deleting port e65d8ecd-299b-4eb6-b38f-841cc50bf309 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:34.347096 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:34.352928 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: b9fd6587-f312-4bff-a7f2-8cf07e521378 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:42:34.353375 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device b9fd6587-f312-4bff-a7f2-8cf07e521378 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:42:34.433857 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] DHCP port deletion for c0bcf70c-dd52-4c1c-bdfb-801657b54172 request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:42:34.483262 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0149807b-11c1-49ce-bd61-f942ea3e9378 req-eee40661-02f0-48d1-94d4-b2d3ceab1723 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1219547
Jun 01 12:42:34.498702 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] For port e65d8ecd-299b-4eb6-b38f-841cc50bf309, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=e65d8ecd-299b-4eb6-b38f-841cc50bf309,segment=NetworkSegment(5d22763a-c728-4d3b-b291-ca264d604a65),segment_id=5d22763a-c728-4d3b-b291-ca264d604a65)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:34.499021 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:34.533798 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] Deleting port e65d8ecd-299b-4eb6-b38f-841cc50bf309 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:42:34.534647 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:34.645179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Calling delete_port for e65d8ecd-299b-4eb6-b38f-841cc50bf309 owned by network:dhcp {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:34.652922 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] For port e65d8ecd-299b-4eb6-b38f-841cc50bf309, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=e65d8ecd-299b-4eb6-b38f-841cc50bf309,segment=NetworkSegment(5d22763a-c728-4d3b-b291-ca264d604a65),segment_id=5d22763a-c728-4d3b-b291-ca264d604a65)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:34.653150 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:34.758034 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:34.764466 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bebaab90-2568-446c-bf2c-094f1cf9e7e2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:34.802083 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] Calling delete_port for e65d8ecd-299b-4eb6-b38f-841cc50bf309 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:42:34.868292 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Pushing event deleted for resources: {'Port': ['ID=e65d8ecd-299b-4eb6-b38f-841cc50bf309,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:34.879488 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device f134ab33-87e8-442b-8165-d6bba1a217db up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:42:34.901053 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.901436 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.901774 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.902129 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.902526 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.902882 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.903317 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.903708 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.904055 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.904597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.904948 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.905292 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:42:34.908071 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] No DVR routers for this DVR port e65d8ecd-299b-4eb6-b38f-841cc50bf309 on host dv-cinder-793515-2-iscsi {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:42:34.909641 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:34.914755 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:34.925568 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:34.988103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] No DVR routers for this DVR port e65d8ecd-299b-4eb6-b38f-841cc50bf309 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:42:35.004602 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] Pushing event deleted for resources: {'Port': ['ID=e65d8ecd-299b-4eb6-b38f-841cc50bf309,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:35.010276 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-0515197b-6a92-497b-94d6-6bf7c67a5bd4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:35.034791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12287a8c-1a18-4f9e-b5ad-7e5833cd566b req-baf86ad1-8b78-47b3-bb35-97ae08949ac8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:35.036893 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-12287a8c-1a18-4f9e-b5ad-7e5833cd566b req-baf86ad1-8b78-47b3-bb35-97ae08949ac8 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1433213
Jun 01 12:42:35.047763 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port f134ab33-87e8-442b-8165-d6bba1a217db completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:42:35.055307 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port f134ab33-87e8-442b-8165-d6bba1a217db triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:42:35.055773 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.067451 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.081951 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a24fb50a0>,) {'filters': {'network_id': ['c0bcf70c-dd52-4c1c-bdfb-801657b54172']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:35.096297 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a24fb50a0>, '5d22763a-c728-4d3b-b291-ca264d604a65') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:35.096719 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a24fb50a0>, '5d22763a-c728-4d3b-b291-ca264d604a65') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:35.101859 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-12287a8c-1a18-4f9e-b5ad-7e5833cd566b req-d9a23a60-21fd-4b7e-82ae-af3cc3b9842c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0531311
Jun 01 12:42:35.109933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.135020 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.144199 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Releasing vlan 785 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:42:35.144710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.224503 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:42:35.232471 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:42:35.239515 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.242967 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:35.261990 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.264433 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:35.264979 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Pushing event deleted for resources: {'Network': ['ID=c0bcf70c-dd52-4c1c-bdfb-801657b54172,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:35.268368 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:35.276628 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39316630-73ec-4d7e-a7e6-f1c6db98bda3" -d '{"events": [{"server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "name": "network-vif-plugged", "status": "completed", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:35.281599 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] 10.222.0.81 "DELETE /v2.0/networks/c0bcf70c-dd52-4c1c-bdfb-801657b54172 HTTP/1.1" status: 204  len: 168 time: 1.2937369
Jun 01 12:42:35.297106 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port f134ab33-87e8-442b-8165-d6bba1a217db, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=f134ab33-87e8-442b-8165-d6bba1a217db,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:35.305860 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.314577 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:35.396239 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9252aaec-b81f-495a-b729-866afae0fc85 x-openstack-request-id: req-9252aaec-b81f-495a-b729-866afae0fc85 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:35.396739 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "name": "network-vif-plugged", "status": "completed", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:35.397097 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-9252aaec-b81f-495a-b729-866afae0fc85 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:35.397755 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'code': 200}
Jun 01 12:42:35.452208 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=f134ab33-87e8-442b-8165-d6bba1a217db,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:35.494025 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:35.518426 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35736) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:35.591041 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-bd6d3a3f-d506-4230-b6e5-8884a0339e41 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=a4d9bab00fe345e0b899bc42ea4416e0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0691156
Jun 01 12:42:35.591282 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35742) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:35.792234 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.836222 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:35.850901 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7510c62b-238f-4f41-a7d2-0d62facf751c req-9be1af5a-87cb-4cfd-93e1-9e3d96cc8f9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:35.852435 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7510c62b-238f-4f41-a7d2-0d62facf751c req-9be1af5a-87cb-4cfd-93e1-9e3d96cc8f9a tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 945 time: 0.2349484
Jun 01 12:42:35.857729 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d397ef-5a53-4931-ae98-62441341801d req-ead3f212-65a3-4f2f-a951-2ad70f7d0019 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:35.859161 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b1d397ef-5a53-4931-ae98-62441341801d req-ead3f212-65a3-4f2f-a951-2ad70f7d0019 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 1098 time: 0.1913769
Jun 01 12:42:35.961245 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-7510c62b-238f-4f41-a7d2-0d62facf751c req-f0b037ff-210b-44bf-aa01-21d8f214765e tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1010587
Jun 01 12:42:35.969956 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b1d397ef-5a53-4931-ae98-62441341801d req-121a40f3-40c8-4bb8-a818-6476660e10f6 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0924377
Jun 01 12:42:36.002373 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:36.007077 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2df86bbe-1db0-4031-a195-d0169f197a04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:36.024367 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11d5a78d-7a8b-4472-a38e-9ee000378394,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:36.027264 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:36.033307 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:36.036551 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/11d5a78d-7a8b-4472-a38e-9ee000378394 HTTP/1.1" status: 204  len: 168 time: 0.4422467
Jun 01 12:42:36.273994 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device e65d8ecd-299b-4eb6-b38f-841cc50bf309 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:36.326332 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: e65d8ecd-299b-4eb6-b38f-841cc50bf309 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:42:36.326956 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device e65d8ecd-299b-4eb6-b38f-841cc50bf309 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:42:36.413179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a2c746-d63b-49cf-a4de-ed56f3d7bce1 req-f6d1b4bf-710c-4e90-b34d-ceda47cf139b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:36.422271 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-10a2c746-d63b-49cf-a4de-ed56f3d7bce1 req-f6d1b4bf-710c-4e90-b34d-ceda47cf139b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1156580
Jun 01 12:42:36.471506 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-10a2c746-d63b-49cf-a4de-ed56f3d7bce1 req-69169f1e-8343-47fc-bd43-bb501c02b168 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0483367
Jun 01 12:42:36.597383 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 35756) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:36.655517 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-0554600a-de30-4585-81cd-7e3ad69b996e admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=96abebccc0734fe388fae3749429552c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0567961
Jun 01 12:42:36.658140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35760) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:36.732873 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-796456d7-4811-414d-a296-d0a620831992 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:36.766090 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-796456d7-4811-414d-a296-d0a620831992 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:36.832740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-796456d7-4811-414d-a296-d0a620831992 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:36.845286 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8815ac5b-5272-471c-a7d3-e4c6a64dd490 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:36.862574 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796456d7-4811-414d-a296-d0a620831992 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f21e766-3de9-4ad3-a551-9d20426ac9d6,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:36.865156 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-796456d7-4811-414d-a296-d0a620831992 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:36.868956 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-796456d7-4811-414d-a296-d0a620831992 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0f21e766-3de9-4ad3-a551-9d20426ac9d6 HTTP/1.1" status: 204  len: 168 time: 0.2072577
Jun 01 12:42:36.868956 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-796456d7-4811-414d-a296-d0a620831992 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:37.216248 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bab9087-8855-4a2e-bcf2-e95e54d756d0 req-856be04f-c539-47f8-a8d4-b0e5136ed612 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:37.224652 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8bab9087-8855-4a2e-bcf2-e95e54d756d0 req-856be04f-c539-47f8-a8d4-b0e5136ed612 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 945 time: 0.1121876
Jun 01 12:42:37.282530 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8bab9087-8855-4a2e-bcf2-e95e54d756d0 req-e6e79fb3-fdbe-4aa8-97cc-11877cceb0bf tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0564508
Jun 01 12:42:37.480490 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca43c52d-3e10-4f7a-b567-00882bed8d85 req-90699f49-c045-4bc9-9708-c44a30075230 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:37.482141 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca43c52d-3e10-4f7a-b567-00882bed8d85 req-90699f49-c045-4bc9-9708-c44a30075230 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 945 time: 0.0928898
Jun 01 12:42:37.547481 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca43c52d-3e10-4f7a-b567-00882bed8d85 req-b06f3f70-25a1-4f1f-a34e-3efddb573eab tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0595222
Jun 01 12:42:37.575754 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35772) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:37.695608 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecc23ed4-cac8-463a-8a1c-14ca30e494cb tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:37.697498 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-ecc23ed4-cac8-463a-8a1c-14ca30e494cb tempest-TestVolumeBootPattern-1590053606 tempest-TestVolumeBootPattern-1590053606-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 1093 time: 0.1198888
Jun 01 12:42:37.701043 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 35778) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:42:37.706411 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Request body: {'floatingip': {'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'port_id': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address': '172.20.0.4'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:42:37.715771 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:42:37.720491 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67c72e9-2fca-4b7f-a19e-7d9710d4d01e req-82614efa-c7da-49bc-9ae0-e754bddd6942 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:37.721310 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Usage tracker for resource:floatingip and tenant:892af7572bdb454483d1279dcfc9ccb0 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:42:37.722086 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f67c72e9-2fca-4b7f-a19e-7d9710d4d01e req-82614efa-c7da-49bc-9ae0-e754bddd6942 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1045375
Jun 01 12:42:37.733945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:42:37.741292 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:42:37.758060 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:37.820654 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-f67c72e9-2fca-4b7f-a19e-7d9710d4d01e req-846347e4-7627-4ea1-962b-7e5b5cb3ce48 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0925992
Jun 01 12:42:38.015681 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:38.176010 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Allocated IP 172.27.3.75 (44ed28c8-c80a-4954-a823-abbd3f7966bf/84d66640-a99d-4108-a81c-3480c5626219/15c52b37-f38a-4e9c-9a28-2dadc003d92d) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:42:38.352633 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:38.391350 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:38.395823 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-37062d4e-21e7-49e7-8628-e49811cbb4b6 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:38.461830 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Network 44ed28c8-c80a-4954-a823-abbd3f7966bf is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:42:38.468558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:42:38.472610 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:42:38.501252 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=15c52b37-f38a-4e9c-9a28-2dadc003d92d,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:38.508324 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:39.108650 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:39.144981 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e089f15-be44-4232-887e-a5fb9f8fb531 req-d9202396-e0c9-4582-84ec-f087ba8bd164 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:39.146554 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6e089f15-be44-4232-887e-a5fb9f8fb531 req-d9202396-e0c9-4582-84ec-f087ba8bd164 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1148503
Jun 01 12:42:39.256729 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6e089f15-be44-4232-887e-a5fb9f8fb531 req-31722c98-e706-498d-8a9f-df610e976396 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0988045
Jun 01 12:42:39.268742 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:39.524900 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:39.530962 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:39.534997 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:39.649741 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event updated for resources: {'Port': ['ID=15c52b37-f38a-4e9c-9a28-2dadc003d92d,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:39.654437 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:39.667618 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:39.845772 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Floating IP 6c4f2780-5e73-457f-b7c3-3364e830961c associated. External IP: 172.27.3.75, port: f134ab33-87e8-442b-8165-d6bba1a217db.
Jun 01 12:42:39.849528 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ef713758-dcf4-4198-9e86-9a772d0c47ef None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:40.316691 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:42:40.490910 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-02441c8d-588f-4b57-a9ee-1791085b44ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:40.492388 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-02441c8d-588f-4b57-a9ee-1791085b44ff service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1098 time: 0.1358538
Jun 01 12:42:40.499737 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:42:40.507965 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c224a1cd-af0a-494e-ae0c-3098bb3f6ac1 req-421f688d-b355-4613-aab2-86827261db05 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:40.509364 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c224a1cd-af0a-494e-ae0c-3098bb3f6ac1 req-421f688d-b355-4613-aab2-86827261db05 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1163681
Jun 01 12:42:40.509512 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:42:40.523250 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:40.523876 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25cc8730>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:40.532336 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:40.602166 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 2.8962700
Jun 01 12:42:40.602166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:40.602166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91" -d '{"events": [{"name": "network-changed", "server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:40.646925 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c2d3da7-e000-4bb0-9bdc-804e7e970e4f x-openstack-request-id: req-6c2d3da7-e000-4bb0-9bdc-804e7e970e4f {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:40.647255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:40.647539 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-6c2d3da7-e000-4bb0-9bdc-804e7e970e4f {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:40.647966 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'status': 'completed', 'code': 200}
Jun 01 12:42:40.671643 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-c224a1cd-af0a-494e-ae0c-3098bb3f6ac1 req-049dfcfc-45f3-4b09-b1d0-ee3d7c5ac684 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1374710
Jun 01 12:42:40.703564 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-e7684a18-2717-4295-9013-0e86cd5b9d2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:40.705141 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-e7684a18-2717-4295-9013-0e86cd5b9d2c service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.1948919
Jun 01 12:42:40.726715 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:40.760388 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-d4d2206d-744d-47d5-acc0-d72d1395466c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:40.761899 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-d4d2206d-744d-47d5-acc0-d72d1395466c service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 1098 time: 0.0869634
Jun 01 12:42:40.817608 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-843437d8-f349-4f6c-a9dc-df379a2e8869 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 200  len: 1000 time: 0.1051645
Jun 01 12:42:40.894879 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-dfa59f66-f00c-40e9-a502-01b1cfeeb90c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:40.896243 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-dfa59f66-f00c-40e9-a502-01b1cfeeb90c service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0683415
Jun 01 12:42:40.902328 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-80d1349f-9f49-4580-9966-a3b3836b1474 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:40.903851 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-80d1349f-9f49-4580-9966-a3b3836b1474 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1347132
Jun 01 12:42:40.983977 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-b746a2ff-934e-4499-ac07-2f61f768403f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:40.985375 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-b746a2ff-934e-4499-ac07-2f61f768403f service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0820329
Jun 01 12:42:41.031883 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-c4193255-8af1-45ee-a7f9-ffff2ef9e4ee service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f134ab33-87e8-442b-8165-d6bba1a217db HTTP/1.1" status: 200  len: 998 time: 0.1220710
Jun 01 12:42:41.102142 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-ee504af3-141d-4f1d-9cc6-dc02d972fbf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:41.104588 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-ee504af3-141d-4f1d-9cc6-dc02d972fbf6 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0664067
Jun 01 12:42:41.139270 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25cc8730>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '6c4f2780-5e73-457f-b7c3-3364e830961c', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.75', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 634, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:68:cf:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:42:38Z', 'updated_at': '2021-06-01T12:42:38Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}, {'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:33Z', 'revision_number': 1, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:41.144211 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:42:41.154953 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:42:41.155838 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25cc8730>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:42:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:41.188782 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-108a9541-8cc4-45bb-9508-9eca58a1f71e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:41.190250 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-108a9541-8cc4-45bb-9508-9eca58a1f71e service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0776939
Jun 01 12:42:41.274756 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-faf48b7f-ef1d-4c8c-88b2-0ae09caa47d0 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2732849
Jun 01 12:42:41.336949 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-027e44a0-cce6-4b35-a7f8-658871f0cf90 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313641
Jun 01 12:42:41.356697 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:42:41.410317 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bfbd0357-cd2d-41cd-bc37-0ca55174bc51 req-271579c3-4dae-45fe-9bda-fa7a83a7a023 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1281226
Jun 01 12:42:41.493584 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-35b49c2d-84d8-4ac4-a5cc-4ba0932ecd91 req-389e375b-979c-4e37-8825-0d54672acfcf service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1494608
Jun 01 12:42:41.722863 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25cc8730>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '6c4f2780-5e73-457f-b7c3-3364e830961c', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.75', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 634, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:68:cf:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:42:38Z', 'updated_at': '2021-06-01T12:42:38Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}, {'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:33Z', 'revision_number': 1, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:42:41.727162 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-975c0080-b7f5-493a-bf23-ecc360233f85 None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '6c4f2780-5e73-457f-b7c3-3364e830961c', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.75', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 634, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:68:cf:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:42:38Z', 'updated_at': '2021-06-01T12:42:38Z', 'revision_number': 0, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}, {'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:33Z', 'revision_number': 1, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:42:41.880933 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dbbc1bd-a4ae-4ef3-ae2d-ebaab44e2421 req-ddc545be-5e3e-42cb-8531-e3b7d09d8d01 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:41.882423 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0dbbc1bd-a4ae-4ef3-ae2d-ebaab44e2421 req-ddc545be-5e3e-42cb-8531-e3b7d09d8d01 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.0879288
Jun 01 12:42:41.916919 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35294c39-793b-4c12-b15c-370bf9621408 None None] New status for floating IP 6c4f2780-5e73-457f-b7c3-3364e830961c: ACTIVE {{(pid=91980) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:42:41.931325 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0dbbc1bd-a4ae-4ef3-ae2d-ebaab44e2421 req-e75e8d26-569b-48d9-8b5f-5e7ae674ae18 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429158
Jun 01 12:42:42.194210 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:42.320090 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:42.503651 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-a98836f2-16df-4c8c-9fdb-e308e8b802cd service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1851544
Jun 01 12:42:42.602364 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-e33b1b70-3c43-4a56-b62d-6f809a33caa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:42.603765 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-e33b1b70-3c43-4a56-b62d-6f809a33caa3 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 1099 time: 0.0712023
Jun 01 12:42:42.683021 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-849850da-ff05-485b-8913-a49653de9ea7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:42.761319 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-42217fed-66a5-4f30-9f18-bff7525203fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:42.762710 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-42217fed-66a5-4f30-9f18-bff7525203fe service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1284316
Jun 01 12:42:42.871388 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-4fcff3df-381e-4bbf-86d0-2671c9e15385 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 HTTP/1.1" status: 200  len: 1002 time: 0.0982659
Jun 01 12:42:42.917119 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:42.936177 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-2db4b26e-5400-4175-8f26-c167fc78fc08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:42.937639 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-2db4b26e-5400-4175-8f26-c167fc78fc08 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0589354
Jun 01 12:42:43.032220 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-91152d3f-d483-47f5-b08b-ac87e525ef51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:43.035176 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-91152d3f-d483-47f5-b08b-ac87e525ef51 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0898962
Jun 01 12:42:43.093096 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:43.123010 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:42:43.125449 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9270c9e6-970e-4265-8356-fbf72f7682c4" -d '{"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-unplugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:42:43.134572 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:42:43.146941 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:43.149162 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:42:43.162903 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e694a4-5d77-4540-8550-d78ccb348db9 req-5dbd1815-fcd7-4d66-b222-3fb3907982d3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:43.164702 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-84e694a4-5d77-4540-8550-d78ccb348db9 req-5dbd1815-fcd7-4d66-b222-3fb3907982d3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 945 time: 0.1079848
Jun 01 12:42:43.231779 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 01 Jun 2021 12:42:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95a25028-1586-4c9b-81bb-eacf737a419b x-openstack-request-id: req-95a25028-1586-4c9b-81bb-eacf737a419b {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:42:43.232310 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-unplugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:42:43.232693 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-95a25028-1586-4c9b-81bb-eacf737a419b {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:42:43.233181 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'code': 200}
Jun 01 12:42:43.234082 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=8']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:42:43.235142 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-84e694a4-5d77-4540-8550-d78ccb348db9 req-f13c2587-a477-4f43-9057-eccc52ef5107 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0641656
Jun 01 12:42:43.246668 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:42:43.270365 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-42971244-d1e3-4f02-b1c0-323f88eff106 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2232277
Jun 01 12:42:43.408767 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a930273c-b8af-4d4c-b1cf-720febf8f681 req-cb598077-a014-4e4d-92ec-48f5bcf8d381 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1278865
Jun 01 12:42:43.872867 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:44.428759 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6824eefb-00ed-43a2-8b34-73f41b99cace req-3c7c72dc-8831-4da0-b98f-519f2f3a38e1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:44.430180 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6824eefb-00ed-43a2-8b34-73f41b99cace req-3c7c72dc-8831-4da0-b98f-519f2f3a38e1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0787234
Jun 01 12:42:44.474975 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6824eefb-00ed-43a2-8b34-73f41b99cace req-81031601-aacb-43c1-bbc7-e2e9bd9f8a61 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392444
Jun 01 12:42:45.428098 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:42:45.948832 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-d9baf141-d3e4-4770-8e61-a1df5c20d236 service neutron] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1002188
Jun 01 12:42:45.957041 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b11d45-dfe9-4cb6-abdd-aa17aac2643b req-80cf6e45-1c3c-4b24-952a-94727fe6a10d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:45.958429 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-11b11d45-dfe9-4cb6-abdd-aa17aac2643b req-80cf6e45-1c3c-4b24-952a-94727fe6a10d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.1451166
Jun 01 12:42:46.006370 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-11b11d45-dfe9-4cb6-abdd-aa17aac2643b req-b4048a06-7e67-4ce2-882d-17014a3ae0d5 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416684
Jun 01 12:42:46.868358 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-ebdc4adf-a0f6-434f-8ec3-437255492621 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:46.870042 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-ebdc4adf-a0f6-434f-8ec3-437255492621 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e&tenant_id=dc771aee219e4d5d914602852a126ac3 HTTP/1.1" status: 200  len: 1096 time: 0.0744689
Jun 01 12:42:46.934221 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:42:46.962875 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-767620c5-02dd-44f5-9c23-febe48e5009f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:46.964311 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-767620c5-02dd-44f5-9c23-febe48e5009f service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1096 time: 0.0698130
Jun 01 12:42:47.095550 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-c199fd28-6dda-41c5-9ea6-1ae0038c5746 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:47.097000 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-c199fd28-6dda-41c5-9ea6-1ae0038c5746 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.1251948
Jun 01 12:42:47.204336 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6970c7ed-91d2-4de8-b966-5c24547bb1cf req-39768815-31e9-4e0a-b815-106d7f6c3a3f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:47.205813 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6970c7ed-91d2-4de8-b966-5c24547bb1cf req-39768815-31e9-4e0a-b815-106d7f6c3a3f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0800455
Jun 01 12:42:47.207028 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-261f7340-e2e5-48d7-8ab1-911d0746f9a5 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 200  len: 998 time: 0.0965967
Jun 01 12:42:47.254920 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6970c7ed-91d2-4de8-b966-5c24547bb1cf req-1821cd6a-706a-465e-99ae-812597599985 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429754
Jun 01 12:42:47.269768 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-a987d985-8308-44b0-8a62-46c9035341a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:47.271208 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-a987d985-8308-44b0-8a62-46c9035341a2 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0571058
Jun 01 12:42:47.349471 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-9fb15727-f4e2-431e-84e3-760072671099 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:47.350923 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-9fb15727-f4e2-431e-84e3-760072671099 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0728164
Jun 01 12:42:47.581745 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-c110736d-0435-4e3b-9f25-5d776a0d5cea service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2178578
Jun 01 12:42:47.713088 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f928170a-c0ba-44a2-b8c2-006d0b3d616d req-5f1203e4-0090-4fea-84b8-208d839895e0 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1235623
Jun 01 12:42:48.479980 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8a35df3-d7bb-4ad8-bbf9-104652eff3f9 req-710f5de7-8281-479f-92bb-9f26034cd5d3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:48.481765 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f8a35df3-d7bb-4ad8-bbf9-104652eff3f9 req-710f5de7-8281-479f-92bb-9f26034cd5d3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0884442
Jun 01 12:42:48.534609 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f8a35df3-d7bb-4ad8-bbf9-104652eff3f9 req-605d5311-67bc-4128-b97a-cf473e770cb1 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0459886
Jun 01 12:42:49.732855 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fca5cc4-a6bb-4555-b954-c56c8a79f297 req-83847e28-99ba-4e92-876c-2fdca3f2f3ad tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:49.734371 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0fca5cc4-a6bb-4555-b954-c56c8a79f297 req-83847e28-99ba-4e92-876c-2fdca3f2f3ad tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0815957
Jun 01 12:42:49.780045 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0fca5cc4-a6bb-4555-b954-c56c8a79f297 req-0ca95703-c282-400e-b4c8-01f74aa26633 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392554
Jun 01 12:42:51.029005 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47168599-f5b3-41f9-9157-221d6335679d req-59a8ab96-e27f-48df-b0ae-4e382ea20d1b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:51.030454 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-47168599-f5b3-41f9-9157-221d6335679d req-59a8ab96-e27f-48df-b0ae-4e382ea20d1b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.1088953
Jun 01 12:42:51.075944 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-47168599-f5b3-41f9-9157-221d6335679d req-baaad734-0c05-4d18-bb05-db19f8984142 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398970
Jun 01 12:42:52.266660 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f15d7e25-3a7c-4471-8d07-fe5ef3560c18 req-462ea96a-b34d-4436-a04c-20de849c9508 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:52.268164 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f15d7e25-3a7c-4471-8d07-fe5ef3560c18 req-462ea96a-b34d-4436-a04c-20de849c9508 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0802770
Jun 01 12:42:52.322481 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f15d7e25-3a7c-4471-8d07-fe5ef3560c18 req-6115dc68-775d-4593-b467-48a55fd8ff70 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0480566
Jun 01 12:42:53.517796 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a2bfdf-d26c-4551-bf70-b2f722aeaa3c req-d784348d-d523-49d0-afdb-dd36917bd4e4 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:53.519229 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37a2bfdf-d26c-4551-bf70-b2f722aeaa3c req-d784348d-d523-49d0-afdb-dd36917bd4e4 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0846140
Jun 01 12:42:53.564297 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37a2bfdf-d26c-4551-bf70-b2f722aeaa3c req-bb353855-c8bb-4d4a-80ea-e30f9eb94d6b tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395446
Jun 01 12:42:54.780717 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2767305c-8981-4683-ba8e-a7879ac57a08 req-f855c08a-2de7-49ce-a29b-8cee9b2e336e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:54.782171 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2767305c-8981-4683-ba8e-a7879ac57a08 req-f855c08a-2de7-49ce-a29b-8cee9b2e336e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.1011827
Jun 01 12:42:54.826516 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2767305c-8981-4683-ba8e-a7879ac57a08 req-21899414-ca0e-4245-a997-383836e8e8e9 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386121
Jun 01 12:42:56.013652 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-721dfe61-5ae1-4784-abcc-970bab0ec444 req-d7b4a735-8fa1-420e-8958-e9b5315582e4 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:56.015091 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-721dfe61-5ae1-4784-abcc-970bab0ec444 req-d7b4a735-8fa1-420e-8958-e9b5315582e4 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0794783
Jun 01 12:42:56.065507 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-721dfe61-5ae1-4784-abcc-970bab0ec444 req-cd098a9e-73a0-429e-aff0-c0b565720251 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445755
Jun 01 12:42:57.273893 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61f6192c-c41b-4279-8f05-2542deef6107 req-c5fc965d-1345-4c39-a9f0-6fc3515dff10 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:57.276024 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-61f6192c-c41b-4279-8f05-2542deef6107 req-c5fc965d-1345-4c39-a9f0-6fc3515dff10 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0889022
Jun 01 12:42:57.320752 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-61f6192c-c41b-4279-8f05-2542deef6107 req-8b79ecd7-8889-4e2e-afe6-c39b101444d2 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389388
Jun 01 12:42:58.511355 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fd8c9b-068c-43e1-a0ff-adcf1e1658b8 req-b57c643b-c5e8-496a-a4f2-2eed84367b1f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:58.512820 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-56fd8c9b-068c-43e1-a0ff-adcf1e1658b8 req-b57c643b-c5e8-496a-a4f2-2eed84367b1f tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0794539
Jun 01 12:42:58.561741 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-56fd8c9b-068c-43e1-a0ff-adcf1e1658b8 req-aec1c703-8945-4934-86d4-f5689e9607d3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0432994
Jun 01 12:42:59.764031 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15af4a50-0a91-4be7-b973-8e7e815a63df req-683265eb-5ceb-4da9-9e47-c062053621fd tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:42:59.765597 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-15af4a50-0a91-4be7-b973-8e7e815a63df req-683265eb-5ceb-4da9-9e47-c062053621fd tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0888598
Jun 01 12:42:59.816703 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-15af4a50-0a91-4be7-b973-8e7e815a63df req-92e48769-acc5-4833-ab91-36434ff5677c tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452883
Jun 01 12:43:01.020536 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-912bda91-3ab4-4af3-b8eb-0e7ebeea3564 req-90522c79-d675-444b-801e-2275d1fff535 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:01.022019 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-912bda91-3ab4-4af3-b8eb-0e7ebeea3564 req-90522c79-d675-444b-801e-2275d1fff535 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0890987
Jun 01 12:43:01.067321 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-912bda91-3ab4-4af3-b8eb-0e7ebeea3564 req-f2806cc8-2d6b-4ce8-8c6e-b4855b670586 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389822
Jun 01 12:43:02.263087 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73832ea9-9a6b-4bb9-9977-a209776e89e6 req-0991f8d9-d018-4e38-9e51-a47a868b8a8d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:02.264882 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-73832ea9-9a6b-4bb9-9977-a209776e89e6 req-0991f8d9-d018-4e38-9e51-a47a868b8a8d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0800910
Jun 01 12:43:02.311960 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-73832ea9-9a6b-4bb9-9977-a209776e89e6 req-483fd295-7395-4eae-9bda-a2e91e34cb84 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401978
Jun 01 12:43:03.514916 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cb1039-aa9c-4c7b-ad06-c50f1d598c1c req-dc885a86-c131-4c94-a50f-d6e490c06609 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:03.516389 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-67cb1039-aa9c-4c7b-ad06-c50f1d598c1c req-dc885a86-c131-4c94-a50f-d6e490c06609 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0830216
Jun 01 12:43:03.562378 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-67cb1039-aa9c-4c7b-ad06-c50f1d598c1c req-2f4c171f-7da5-47ee-9de8-6253c4c3bf88 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402761
Jun 01 12:43:04.755979 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661743d8-5f9c-4a01-8ec0-fc922e7569f4 req-4cf69947-469a-423d-9682-6a829f824a7e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:04.757347 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-661743d8-5f9c-4a01-8ec0-fc922e7569f4 req-4cf69947-469a-423d-9682-6a829f824a7e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 943 time: 0.0832894
Jun 01 12:43:04.800809 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-661743d8-5f9c-4a01-8ec0-fc922e7569f4 req-89be7f2f-1ade-46f4-88df-a6d15a0894fe tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0378180
Jun 01 12:43:05.045327 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:43:05.177315 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:05.191496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'port_id': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'mac_address': 'fa:16:3e:54:1d:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 756, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:43:05.248850 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:05.264945 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79b6ede7-bda5-4259-8b84-707dcd1fda2e {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:43:05.280211 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:05.284353 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:05.287065 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:05.354534 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=9']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:05.358256 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:05.535459 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['79b6ede7-bda5-4259-8b84-707dcd1fda2e'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:43:05.987659 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3878cb1-b8cd-4cb3-85c4-9d8f454a8806 req-c5f309a2-a70c-4ec4-b361-f0718559e7d4 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:05.989117 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f3878cb1-b8cd-4cb3-85c4-9d8f454a8806 req-c5f309a2-a70c-4ec4-b361-f0718559e7d4 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 944 time: 0.0784328
Jun 01 12:43:06.032690 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f3878cb1-b8cd-4cb3-85c4-9d8f454a8806 req-b385c3bc-93b1-4aa9-8fa2-1f6bf85b4c8e tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0379815
Jun 01 12:43:06.877745 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:43:07.060109 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:43:07.132076 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 79b6ede7-bda5-4259-8b84-707dcd1fda2e triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:43:07.132645 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:07.223306 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba6d5f01-25eb-494c-bfab-818c1c43b2ba req-cb8cc985-51f6-44bf-8b5d-ffd9a11cbd37 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:07.224770 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ba6d5f01-25eb-494c-bfab-818c1c43b2ba req-cb8cc985-51f6-44bf-8b5d-ffd9a11cbd37 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 944 time: 0.0808442
Jun 01 12:43:07.252258 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:07.270715 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ba6d5f01-25eb-494c-bfab-818c1c43b2ba req-c33f2d54-12b3-4245-a4d3-d0807b79d146 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396235
Jun 01 12:43:07.278255 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:43:07.280482 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ea42058-3fc5-4987-9601-a12a47a12ccb" -d '{"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-plugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:43:07.290243 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:07.295572 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:07.298667 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-c3c95b4c-0cef-4d5c-9f43-244e3b47e804 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:07.330077 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:43:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ea8a252-d698-4f28-82cd-1ee0acd0ea34 x-openstack-request-id: req-0ea8a252-d698-4f28-82cd-1ee0acd0ea34 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:43:07.330370 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-plugged", "status": "completed", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:43:07.330619 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-0ea8a252-d698-4f28-82cd-1ee0acd0ea34 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:43:07.330997 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'code': 200}
Jun 01 12:43:07.368886 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=10']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:07.372202 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:07.574160 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04dda0e-ba59-47fc-8848-0f2db6162a57 req-6af82e7c-9bf7-4df9-ab81-6c3df5dfa9ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:07.575453 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d04dda0e-ba59-47fc-8848-0f2db6162a57 req-6af82e7c-9bf7-4df9-ab81-6c3df5dfa9ac service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1099 time: 0.0745294
Jun 01 12:43:07.621648 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d04dda0e-ba59-47fc-8848-0f2db6162a57 req-af82b513-72dd-48ef-a713-bedbb4acb9e1 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0349770
Jun 01 12:43:08.465878 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e58b70-b3c1-433f-b761-c39a728f3e67 req-cebb9d37-d7f5-42ca-9714-4a2a3949933a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:08.467383 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-62e58b70-b3c1-433f-b761-c39a728f3e67 req-cebb9d37-d7f5-42ca-9714-4a2a3949933a tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 946 time: 0.0859387
Jun 01 12:43:08.513356 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-62e58b70-b3c1-433f-b761-c39a728f3e67 req-3a55d8c3-7b82-470f-b1b7-533a298c5af3 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402958
Jun 01 12:43:09.702094 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e81f1c4-e2fd-43f2-a3d1-4f3593b02104 req-aba87ea0-800b-4fd6-bec9-b8feb5255c70 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:09.703527 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8e81f1c4-e2fd-43f2-a3d1-4f3593b02104 req-aba87ea0-800b-4fd6-bec9-b8feb5255c70 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 946 time: 0.0788088
Jun 01 12:43:09.750799 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-8e81f1c4-e2fd-43f2-a3d1-4f3593b02104 req-9fcbfa54-2886-491c-9f95-9904e69c1522 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416543
Jun 01 12:43:09.843547 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-788bed5f-b4ea-4a76-aa6b-fbfa67538c35 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:12.147464 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:12.322340 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:12.684450 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-af608cef-5275-40a5-858b-473c23d396e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:13.874528 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:15.429115 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:28.813609 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99caefb5-021d-4a2d-89e1-32ec01003c8d req-1c4de069-a3af-4460-bdf4-f2710e5aa80f tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:28.815082 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-99caefb5-021d-4a2d-89e1-32ec01003c8d req-1c4de069-a3af-4460-bdf4-f2710e5aa80f tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 946 time: 0.0793836
Jun 01 12:43:28.863195 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-99caefb5-021d-4a2d-89e1-32ec01003c8d req-fc94dd99-b146-4b41-ac14-b558b31d3236 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423806
Jun 01 12:43:30.050582 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdae0559-ca59-4677-b66a-1c2c9ec7c5a7 req-efc1df07-4b87-4194-b71a-e67e0f7480b6 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:30.052021 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cdae0559-ca59-4677-b66a-1c2c9ec7c5a7 req-efc1df07-4b87-4194-b71a-e67e0f7480b6 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 946 time: 0.0788856
Jun 01 12:43:30.096107 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cdae0559-ca59-4677-b66a-1c2c9ec7c5a7 req-50482807-9959-41c1-9e3f-99ad56c80a5a tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384924
Jun 01 12:43:30.554511 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-03be5ed0-e6fc-483d-97ed-709941aaa0de tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:30.556020 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-03be5ed0-e6fc-483d-97ed-709941aaa0de tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 946 time: 0.1737456
Jun 01 12:43:30.704495 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Deleting port 6633768a-79da-4774-b28b-ed453c345dfa {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:43:30.704913 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:30.834781 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] For port 6633768a-79da-4774-b28b-ed453c345dfa, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=6633768a-79da-4774-b28b-ed453c345dfa,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:30.835029 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:30.957432 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Calling delete_port for 6633768a-79da-4774-b28b-ed453c345dfa owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:43:31.066477 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:31.071740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f378e152-af72-4e81-a5e5-dbcda79a6e8d tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:31.077577 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['6633768a-79da-4774-b28b-ed453c345dfa'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:43:31.122095 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Pushing event deleted for resources: {'Port': ['ID=6633768a-79da-4774-b28b-ed453c345dfa,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:31.147586 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:31.193750 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] No DVR routers for this DVR port 6633768a-79da-4774-b28b-ed453c345dfa on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:43:31.196682 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:31.199441 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'name': 'network-vif-deleted', 'tag': '6633768a-79da-4774-b28b-ed453c345dfa'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:43:31.201738 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0e0f97d-3fd0-4f53-b79f-94d8fc458da8" -d '{"events": [{"server_uuid": "74b314d5-d1f6-4c22-8124-289e77ae54c3", "name": "network-vif-deleted", "tag": "6633768a-79da-4774-b28b-ed453c345dfa"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:43:31.216952 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-83b464f4-36e0-4193-a150-018e2ede5b73 req-6386179b-bfbd-412b-b9c7-73671c8a3136 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "DELETE /v2.0/ports/6633768a-79da-4774-b28b-ed453c345dfa HTTP/1.1" status: 204  len: 173 time: 0.6527991
Jun 01 12:43:31.248927 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:43:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a797441-1ecc-4e0d-9bae-c46d36302e33 x-openstack-request-id: req-9a797441-1ecc-4e0d-9bae-c46d36302e33 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:43:31.249260 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "74b314d5-d1f6-4c22-8124-289e77ae54c3", "name": "network-vif-deleted", "tag": "6633768a-79da-4774-b28b-ed453c345dfa", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:43:31.249565 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-9a797441-1ecc-4e0d-9bae-c46d36302e33 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:43:31.250110 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '74b314d5-d1f6-4c22-8124-289e77ae54c3', 'name': 'network-vif-deleted', 'tag': '6633768a-79da-4774-b28b-ed453c345dfa', 'status': 'completed', 'code': 200}
Jun 01 12:43:31.254129 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-34609c73-e452-463e-aea0-0b6c1ae2d14e req-7c6ee0e6-5234-4b9b-9dbc-0846a86a4d0e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=74b314d5-d1f6-4c22-8124-289e77ae54c3 HTTP/1.1" status: 200  len: 210 time: 0.0465615
Jun 01 12:43:33.883704 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 6633768a-79da-4774-b28b-ed453c345dfa no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:43:33.917893 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 6633768a-79da-4774-b28b-ed453c345dfa {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:43:33.918237 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 6633768a-79da-4774-b28b-ed453c345dfa not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:43:39.844120 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-0d60265f-7361-4957-8228-b4a5fe2680a9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:42.147059 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:42.325593 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:42.691224 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-207882ed-f773-4ba9-8db2-f817ad692dbb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:42.851721 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-fc056975-9e41-42ec-b186-6035398f8b20 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:42.853189 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-fc056975-9e41-42ec-b186-6035398f8b20 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/networks?id=1308baa5-7150-4a84-ac5f-c2c161212d06 HTTP/1.1" status: 200  len: 813 time: 0.1566067
Jun 01 12:43:42.869372 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-68970eb9-1000-4c98-8fe6-ca14b50dcfa8 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/quotas/5a84a76793e14c6f80e91f0ce9a6e26e HTTP/1.1" status: 200  len: 375 time: 0.0097644
Jun 01 12:43:42.916165 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-8d668659-4162-4346-b526-edf31e3b8c92 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=5a84a76793e14c6f80e91f0ce9a6e26e&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0414801
Jun 01 12:43:43.054772 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c0c81bfb-00cd-497f-be94-29fc5871e0a2 service neutron] 10.222.0.81 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1313431
Jun 01 12:43:43.192328 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-f1565e65-8fcc-4f55-b645-9a81a2e45923 service neutron] 10.222.0.81 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1317930
Jun 01 12:43:43.429148 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-4ae4e576-008e-4e66-99f8-016219b22629 req-9e162bad-b421-4028-a2e5-6e0425d925bb tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Synchronizing usage tracker for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:43:43.460540 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-4ae4e576-008e-4e66-99f8-016219b22629 req-9e162bad-b421-4028-a2e5-6e0425d925bb tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Unset dirty status for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:43:43.462100 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-4ae4e576-008e-4e66-99f8-016219b22629 req-9e162bad-b421-4028-a2e5-6e0425d925bb tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 210 time: 0.1376705
Jun 01 12:43:43.486039 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-98544f38-083b-4e46-b9e9-a8d4eb874ec9 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1092584
Jun 01 12:43:43.585934 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-805d76ca-7943-46af-8210-fe6fbab6b223 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:43.587553 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-805d76ca-7943-46af-8210-fe6fbab6b223 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=dc771aee219e4d5d914602852a126ac3&device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 1099 time: 0.0757234
Jun 01 12:43:43.741283 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-a23904a8-6410-4249-8703-684ed37ba9b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:43.742804 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-a23904a8-6410-4249-8703-684ed37ba9b5 service neutron] 10.222.0.95 "GET /v2.0/networks?id=a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 200  len: 917 time: 0.1352193
Jun 01 12:43:43.852363 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-30005a6a-189f-4b91-ba45-8340dce99d58 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 200  len: 1000 time: 0.1017406
Jun 01 12:43:43.878539 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:43:43.881975 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:43.917954 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-9ea88722-ce4e-42fc-b2fc-0161fccf1209 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:43.920052 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-9ea88722-ce4e-42fc-b2fc-0161fccf1209 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 200  len: 855 time: 0.0606987
Jun 01 12:43:44.002321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-53946e0b-9dba-433e-882b-4171e3a266ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:44.003691 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-53946e0b-9dba-433e-882b-4171e3a266ef service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=a2f45554-20a3-4b02-a9ad-473554e8b2ed&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0771074
Jun 01 12:43:44.137963 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-8a1f6789-0ed9-4aa2-b492-eb613fc44e77 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1241739
Jun 01 12:43:44.275050 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-274c23d8-0dd2-412d-960e-ed5d6407992b req-7119f3c8-56be-4dc3-8cee-fd2040dd8c98 service neutron] 10.222.0.95 "GET /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1284406
Jun 01 12:43:44.574371 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-2b168979-cc61-4846-b3a3-c3a5e0cb6412 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:44.575809 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-2b168979-cc61-4846-b3a3-c3a5e0cb6412 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "GET /v2.0/networks?id=1308baa5-7150-4a84-ac5f-c2c161212d06 HTTP/1.1" status: 200  len: 813 time: 0.2344522
Jun 01 12:43:44.590226 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Request body: {'port': {'device_id': '189976fe-f830-4f9a-b107-aabdb6275028', 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06', 'admin_state_up': True, 'tenant_id': '5a84a76793e14c6f80e91f0ce9a6e26e'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:43:44.653433 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-37f59326-8901-4f6f-976a-b0a3168da910 req-4715edcd-e814-40f0-868f-250709ed85c7 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 210 time: 0.0496378
Jun 01 12:43:44.731886 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:43:44.742430 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:43:44.751532 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Made reservation on behalf of 5a84a76793e14c6f80e91f0ce9a6e26e for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:43:44.754937 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:44.911865 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Allocated IP 172.20.0.4 (1308baa5-7150-4a84-ac5f-c2c161212d06/c3173bfc-9767-47db-882f-01b7eae76aff/9d7bf369-9226-479c-9da9-1271f74f5b42) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:43:45.110496 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:45.140920 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:45.145863 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d66215db-be38-4abb-992f-b4f816e6f797 tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:45.210813 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Network 1308baa5-7150-4a84-ac5f-c2c161212d06 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:43:45.214496 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:43:45.218299 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:43:45.248182 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Pushing event updated for resources: {'Port': ['ID=9d7bf369-9226-479c-9da9-1271f74f5b42,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:45.267124 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.267522 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.268041 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.268374 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.268784 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.268928 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.269174 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.269512 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.269851 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.270188 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.270524 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.270859 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:45.276714 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:45.293590 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:45.294185 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:45.320772 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.7350054
Jun 01 12:43:45.335539 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Request body: {'port': {'device_id': '189976fe-f830-4f9a-b107-aabdb6275028', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:43:45.433981 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:45.448947 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:45.829891 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9d7bf369-9226-479c-9da9-1271f74f5b42 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:43:45.843693 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:45.863470 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Transition to ACTIVE for port object 9d7bf369-9226-479c-9da9-1271f74f5b42 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:43:45.866929 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:45.872311 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:46.001752 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a879a84-9585-4819-9579-3b11186791b1 req-142a3119-46f6-4673-80b1-b3be5c75398a tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:46.002498 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-5a879a84-9585-4819-9579-3b11186791b1 req-142a3119-46f6-4673-80b1-b3be5c75398a tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Synchronizing usage tracker for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:43:46.039951 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Pushing event updated for resources: {'Port': ['ID=9d7bf369-9226-479c-9da9-1271f74f5b42,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:46.051167 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:46.093618 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-5a879a84-9585-4819-9579-3b11186791b1 req-142a3119-46f6-4673-80b1-b3be5c75398a tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Unset dirty status for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:43:46.094825 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5a879a84-9585-4819-9579-3b11186791b1 req-142a3119-46f6-4673-80b1-b3be5c75398a tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 931 time: 0.3224819
Jun 01 12:43:46.156792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Attempting to bind port 9d7bf369-9226-479c-9da9-1271f74f5b42 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:43:46.157145 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Attempting to bind port 9d7bf369-9226-479c-9da9-1271f74f5b42 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:43:46.157465 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Attempting to bind port 9d7bf369-9226-479c-9da9-1271f74f5b42 on network 1308baa5-7150-4a84-ac5f-c2c161212d06 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:43:46.163115 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5a879a84-9585-4819-9579-3b11186791b1 req-6f07f5b5-dcb2-464d-9278-75e031f81ecc tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618007
Jun 01 12:43:46.164879 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Port 9d7bf369-9226-479c-9da9-1271f74f5b42 on network 1308baa5-7150-4a84-ac5f-c2c161212d06 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:43:46.165192 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Attempting to bind port 9d7bf369-9226-479c-9da9-1271f74f5b42 on network 1308baa5-7150-4a84-ac5f-c2c161212d06 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:43:46.170854 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 43, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:43:46.171188 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Checking segment: {'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:43:46.171557 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Bound using segment: {'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:43:46.171973 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Bound port: 9d7bf369-9226-479c-9da9-1271f74f5b42, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0639fdd3-7524-43ac-8e87-bab2babae079', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 754, 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:43:46.172314 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:46.341748 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] For port 9d7bf369-9226-479c-9da9-1271f74f5b42, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:43:46.345337 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] For port 9d7bf369-9226-479c-9da9-1271f74f5b42, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9d7bf369-9226-479c-9da9-1271f74f5b42,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:43:46.349253 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:46.352740 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ad459cba-0b54-405a-95d4-3712bbe4c422 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:46.409182 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:46.409784 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:46.411113 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] 10.222.0.95 "PUT /v2.0/ports/9d7bf369-9226-479c-9da9-1271f74f5b42 HTTP/1.1" status: 200  len: 1093 time: 1.0799518
Jun 01 12:43:46.411643 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '189976fe-f830-4f9a-b107-aabdb6275028', 'tag': '9d7bf369-9226-479c-9da9-1271f74f5b42'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:43:46.413906 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-792d428d-2b77-43f7-9cdb-8eaf9abb087f" -d '{"events": [{"name": "network-changed", "server_uuid": "189976fe-f830-4f9a-b107-aabdb6275028", "tag": "9d7bf369-9226-479c-9da9-1271f74f5b42"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:43:46.431959 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Pushing event updated for resources: {'Port': ['ID=9d7bf369-9226-479c-9da9-1271f74f5b42,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:46.435278 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:46.488058 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:43:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77a0855e-b3ff-45b9-a4d5-fd5d163cd56a x-openstack-request-id: req-77a0855e-b3ff-45b9-a4d5-fd5d163cd56a {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:43:46.488381 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "189976fe-f830-4f9a-b107-aabdb6275028", "tag": "9d7bf369-9226-479c-9da9-1271f74f5b42", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:43:46.488709 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-77a0855e-b3ff-45b9-a4d5-fd5d163cd56a {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:43:46.489123 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '189976fe-f830-4f9a-b107-aabdb6275028', 'tag': '9d7bf369-9226-479c-9da9-1271f74f5b42', 'status': 'completed', 'code': 200}
Jun 01 12:43:46.531226 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-409ceddc-cddf-4af1-8f91-457d44c79002 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:46.532786 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-409ceddc-cddf-4af1-8f91-457d44c79002 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5a84a76793e14c6f80e91f0ce9a6e26e&device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 1096 time: 0.0824716
Jun 01 12:43:46.602935 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-b3aa1303-b173-48cc-b541-1af4a5c32f62 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=9d7bf369-9226-479c-9da9-1271f74f5b42 HTTP/1.1" status: 200  len: 217 time: 0.0598691
Jun 01 12:43:46.668502 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-8a2360fa-f538-467b-8b9a-b2eea45c1383 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:46.669922 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-8a2360fa-f538-467b-8b9a-b2eea45c1383 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=c3173bfc-9767-47db-882f-01b7eae76aff HTTP/1.1" status: 200  len: 853 time: 0.0598245
Jun 01 12:43:46.718781 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-059e4ad4-7b4a-4295-8ef1-61f6b4303945 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=1308baa5-7150-4a84-ac5f-c2c161212d06&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0394669
Jun 01 12:43:46.859112 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-b6d2a9de-b92c-41f8-892d-12cedef089da service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1245573
Jun 01 12:43:46.990624 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-da954f6c-4859-40b0-8b7e-cddeefd35c2c req-ecf866fb-3073-4d1b-ab6c-e84378eeda4b service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1246190
Jun 01 12:43:47.115266 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-ff353a7d-8f28-4060-ad93-0a05d316b208 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:47.116614 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-ff353a7d-8f28-4060-ad93-0a05d316b208 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=5a84a76793e14c6f80e91f0ce9a6e26e&device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 1096 time: 0.0717912
Jun 01 12:43:47.246545 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-640e744d-19f0-42ec-8938-95634efd4337 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:47.247937 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-640e744d-19f0-42ec-8938-95634efd4337 service neutron] 10.222.0.95 "GET /v2.0/networks?id=1308baa5-7150-4a84-ac5f-c2c161212d06 HTTP/1.1" status: 200  len: 914 time: 0.1251769
Jun 01 12:43:47.350526 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-5b1ee03a-f021-464f-8ff2-5bae4a379b3c service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=9d7bf369-9226-479c-9da9-1271f74f5b42 HTTP/1.1" status: 200  len: 217 time: 0.0945604
Jun 01 12:43:47.430649 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-2781c156-3e6c-4fb0-b718-519db82e9cfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:47.432052 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-2781c156-3e6c-4fb0-b718-519db82e9cfc service neutron] 10.222.0.95 "GET /v2.0/subnets?id=c3173bfc-9767-47db-882f-01b7eae76aff HTTP/1.1" status: 200  len: 853 time: 0.0718951
Jun 01 12:43:47.475997 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca3f20eb-425b-48c0-8e69-ad2c64f49e21 req-468c08e5-142b-41ff-9907-bcea5ad04b27 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:47.477359 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca3f20eb-425b-48c0-8e69-ad2c64f49e21 req-468c08e5-142b-41ff-9907-bcea5ad04b27 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 943 time: 0.1760004
Jun 01 12:43:47.503708 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-5dcbd128-ed37-436f-aaa8-759d8862ac39 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=1308baa5-7150-4a84-ac5f-c2c161212d06&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0637169
Jun 01 12:43:47.594068 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ca3f20eb-425b-48c0-8e69-ad2c64f49e21 req-594694f5-d97b-48d9-8218-6ffb4724061d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1105001
Jun 01 12:43:47.656453 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-aa27d8b0-fbc4-45c7-ac73-35be5990d098 service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1383376
Jun 01 12:43:47.786960 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-792d428d-2b77-43f7-9cdb-8eaf9abb087f req-2bdf9f99-4cae-423b-90f6-4ce6c9167bec service neutron] 10.222.0.95 "GET /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1229131
Jun 01 12:43:48.780033 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abb592cc-9a18-46bf-a20c-6dede3774d5d req-94d70bc8-3ea3-44f2-9a4d-b6591e3b393e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:48.781550 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-abb592cc-9a18-46bf-a20c-6dede3774d5d req-94d70bc8-3ea3-44f2-9a4d-b6591e3b393e tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 943 time: 0.0812919
Jun 01 12:43:48.829525 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-abb592cc-9a18-46bf-a20c-6dede3774d5d req-116c6958-5cae-41e1-b74e-396a8d188316 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0417128
Jun 01 12:43:49.241660 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9d7bf369-9226-479c-9da9-1271f74f5b42 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:43:49.376635 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 9d7bf369-9226-479c-9da9-1271f74f5b42, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9d7bf369-9226-479c-9da9-1271f74f5b42,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:49.389599 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '9d7bf369-9226-479c-9da9-1271f74f5b42', 'network_id': '1308baa5-7150-4a84-ac5f-c2c161212d06', 'port_id': '9d7bf369-9226-479c-9da9-1271f74f5b42', 'mac_address': 'fa:16:3e:9f:01:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 754, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c3173bfc-9767-47db-882f-01b7eae76aff', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:43:49.446189 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:49.462359 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9d7bf369-9226-479c-9da9-1271f74f5b42 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:43:49.477839 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 9d7bf369-9226-479c-9da9-1271f74f5b42, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9d7bf369-9226-479c-9da9-1271f74f5b42,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:49.482276 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:49.484012 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:49.548070 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=9d7bf369-9226-479c-9da9-1271f74f5b42,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:49.555378 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.555716 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.556046 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.556370 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.556718 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.557071 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.557387 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.557703 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.558027 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.558336 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.558680 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.558999 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:43:49.562718 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:49.759338 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['9d7bf369-9226-479c-9da9-1271f74f5b42'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:43:50.024390 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f35e0fe-60e0-4982-91f9-8627439d908b req-2634abd6-b397-434f-8fae-fc09d5e87aac tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:50.025733 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9f35e0fe-60e0-4982-91f9-8627439d908b req-2634abd6-b397-434f-8fae-fc09d5e87aac tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 944 time: 0.0799472
Jun 01 12:43:50.070805 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9f35e0fe-60e0-4982-91f9-8627439d908b req-15e80e6c-1c55-47f9-8aac-482cab5b3acd tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382278
Jun 01 12:43:51.248329 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9d7bf369-9226-479c-9da9-1271f74f5b42 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:43:51.318879 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 9d7bf369-9226-479c-9da9-1271f74f5b42 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:43:51.323907 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 9d7bf369-9226-479c-9da9-1271f74f5b42 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:43:51.324484 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:51.362418 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5479bd44-fbed-4230-b6e3-5037f5400149 req-9ef3ffab-fdcb-4efa-97c1-ba2620a2ae56 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:51.364364 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5479bd44-fbed-4230-b6e3-5037f5400149 req-9ef3ffab-fdcb-4efa-97c1-ba2620a2ae56 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 944 time: 0.1850433
Jun 01 12:43:51.410315 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5479bd44-fbed-4230-b6e3-5037f5400149 req-09489a89-9627-4cc0-a59d-4995468a143b tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406036
Jun 01 12:43:51.475243 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:51.502496 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '189976fe-f830-4f9a-b107-aabdb6275028', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d7bf369-9226-479c-9da9-1271f74f5b42'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:43:51.504571 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa8d933e-876a-4c14-b360-d17326586c30" -d '{"events": [{"server_uuid": "189976fe-f830-4f9a-b107-aabdb6275028", "name": "network-vif-plugged", "status": "completed", "tag": "9d7bf369-9226-479c-9da9-1271f74f5b42"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:43:51.513360 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 9d7bf369-9226-479c-9da9-1271f74f5b42, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9d7bf369-9226-479c-9da9-1271f74f5b42,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:51.519010 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:51.521372 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:51.561163 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:43:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-561290b1-cf7f-4dca-922a-29dc2e399ab7 x-openstack-request-id: req-561290b1-cf7f-4dca-922a-29dc2e399ab7 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:43:51.561537 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "189976fe-f830-4f9a-b107-aabdb6275028", "name": "network-vif-plugged", "status": "completed", "tag": "9d7bf369-9226-479c-9da9-1271f74f5b42", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:43:51.561797 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-561290b1-cf7f-4dca-922a-29dc2e399ab7 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:43:51.562198 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '189976fe-f830-4f9a-b107-aabdb6275028', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9d7bf369-9226-479c-9da9-1271f74f5b42', 'code': 200}
Jun 01 12:43:51.597372 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=9d7bf369-9226-479c-9da9-1271f74f5b42,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:51.600368 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:51.794234 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273e943d-7579-4153-bae4-13101020edd6 req-afc116d5-e7f3-4c1d-95cd-8e057b2b1ca9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:51.795812 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-273e943d-7579-4153-bae4-13101020edd6 req-afc116d5-e7f3-4c1d-95cd-8e057b2b1ca9 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 1098 time: 0.0755165
Jun 01 12:43:51.929990 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-273e943d-7579-4153-bae4-13101020edd6 req-f4553583-7b3c-4fde-a80e-858130179ea8 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1273358
Jun 01 12:43:52.224447 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67321fde-e3f8-4a32-9c10-a469f0345b24 req-090b1734-16a6-438f-9aa5-dbe5fb0cc80d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:52.226034 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-67321fde-e3f8-4a32-9c10-a469f0345b24 req-090b1734-16a6-438f-9aa5-dbe5fb0cc80d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 946 time: 0.0815442
Jun 01 12:43:52.274166 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-67321fde-e3f8-4a32-9c10-a469f0345b24 req-4424f9db-5c4a-467c-85eb-faf22ebd2455 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423813
Jun 01 12:43:52.604162 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40347d5b-5281-4a29-9890-22fd1229c78e req-5f0d8c66-1372-4ff7-9195-0e7720cb66c2 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:52.605566 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-40347d5b-5281-4a29-9890-22fd1229c78e req-5f0d8c66-1372-4ff7-9195-0e7720cb66c2 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 945 time: 0.0832279
Jun 01 12:43:52.654280 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-40347d5b-5281-4a29-9890-22fd1229c78e req-30a7de9d-fa66-4b42-9cbb-7fd37e7d10b2 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431259
Jun 01 12:43:53.464523 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac6cb66d-722b-4dde-860c-24846dbafc9a req-1714185e-1f93-4499-9964-2568bb0f4355 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:53.465985 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ac6cb66d-722b-4dde-860c-24846dbafc9a req-1714185e-1f93-4499-9964-2568bb0f4355 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 946 time: 0.0807376
Jun 01 12:43:53.509655 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ac6cb66d-722b-4dde-860c-24846dbafc9a req-b3f4454c-a58f-47e6-b166-4f1488a0391d tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups?id=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0377831
Jun 01 12:43:53.621508 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a72087b-f3ac-47a4-a7a4-353db3ec8772 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:53.622913 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a72087b-f3ac-47a4-a7a4-353db3ec8772 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 946 time: 0.0802729
Jun 01 12:43:53.756189 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Deleting port 79b6ede7-bda5-4259-8b84-707dcd1fda2e {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:43:53.756433 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:53.838027 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa4a89e-6804-40fd-9056-2eefd5ecd14a req-58efe2d6-9f80-4ff3-96b6-2b5b5deeb7b5 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:43:53.840222 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0aa4a89e-6804-40fd-9056-2eefd5ecd14a req-58efe2d6-9f80-4ff3-96b6-2b5b5deeb7b5 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 945 time: 0.0828092
Jun 01 12:43:53.885964 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0aa4a89e-6804-40fd-9056-2eefd5ecd14a req-b7beb34d-3044-4903-8aea-8618d1edefd7 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394976
Jun 01 12:43:53.889146 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] For port 79b6ede7-bda5-4259-8b84-707dcd1fda2e, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=79b6ede7-bda5-4259-8b84-707dcd1fda2e,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:43:53.889504 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:54.183607 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:54.183970 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1981239'] for floatingip, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:54.184275 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Floating IP ed705b00-9053-4494-a4c2-691fd296b3ad disassociated. External IP: 172.27.3.33, port: 79b6ede7-bda5-4259-8b84-707dcd1fda2e.
Jun 01 12:43:54.184637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Calling delete_port for 79b6ede7-bda5-4259-8b84-707dcd1fda2e owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:43:54.310154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:54.318155 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8d5e1727-769b-4d43-a815-9897616e6579 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:54.367626 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event deleted for resources: {'Port': ['ID=79b6ede7-bda5-4259-8b84-707dcd1fda2e,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:54.371201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:54.565316 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Router 7e176463-91d5-4735-ab79-0ea7c34c6767 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:43:54.667912 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-deef3e77-ce59-48f0-afc6-0f104593c202 req-00c8a741-835e-48af-89fd-6b1323c80eab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/ports?device_id=ff4072d6-5da8-4810-8f0c-05356421873e HTTP/1.1" status: 200  len: 210 time: 0.0462530
Jun 01 12:43:54.744201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:43:54.755758 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] Sync routers for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:43:54.767461 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:43:54.768674 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25c14d00>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:43:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:43:54.922241 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] No DVR routers for this DVR port 79b6ede7-bda5-4259-8b84-707dcd1fda2e on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:43:54.924810 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:54.927484 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-deleted', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:43:54.930050 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3390af92-5e43-4c60-bd30-6f042126ba9a" -d '{"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-deleted", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:43:54.945580 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-28300526-388c-4e53-b98d-9a06c8eb76ec req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.95 "DELETE /v2.0/ports/79b6ede7-bda5-4259-8b84-707dcd1fda2e HTTP/1.1" status: 204  len: 173 time: 1.3159935
Jun 01 12:43:54.973864 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:43:54.981736 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:43:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4072e2f6-885a-4914-9ec5-51c0d810c813 x-openstack-request-id: req-4072e2f6-885a-4914-9ec5-51c0d810c813 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:43:54.982074 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ff4072d6-5da8-4810-8f0c-05356421873e", "name": "network-vif-deleted", "tag": "79b6ede7-bda5-4259-8b84-707dcd1fda2e", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:43:54.982433 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-4072e2f6-885a-4914-9ec5-51c0d810c813 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:43:54.982874 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ff4072d6-5da8-4810-8f0c-05356421873e', 'name': 'network-vif-deleted', 'tag': '79b6ede7-bda5-4259-8b84-707dcd1fda2e', 'status': 'completed', 'code': 200}
Jun 01 12:43:55.291071 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25c14d00>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:43:55.295347 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] Checking router: 7e176463-91d5-4735-ab79-0ea7c34c6767 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:43:55.303484 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:43:55.304076 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25c14d00>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:43:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:43:55.481329 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:43:55.791007 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25c14d00>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:43:55.794894 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5707e25-0ba0-497f-b063-8c665632b61e None None] The sync data for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi is: [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:38:12Z', 'revision_number': 4, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': 'abab8eea-b119-4add-835f-fd819aeea2ce', 'name': '', 'network_id': 'a2f45554-20a3-4b02-a9ad-473554e8b2ed', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'mac_address': 'fa:16:3e:bb:e0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_interface', 'standard_attr_id': 524, 'fixed_ips': [{'subnet_id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:10Z', 'updated_at': '2021-06-01T12:38:21Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'subnets': [{'id': '37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:43:55.802538 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36234) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:43:55.869439 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b518f37-0dc7-4d90-8540-d7dfce3b7932 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:55.897601 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b518f37-0dc7-4d90-8540-d7dfce3b7932 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:55.953421 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b518f37-0dc7-4d90-8540-d7dfce3b7932 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:55.957786 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-904961df-4017-426a-917e-d8414c816ead admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:55.973978 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b518f37-0dc7-4d90-8540-d7dfce3b7932 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:55.976723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7b518f37-0dc7-4d90-8540-d7dfce3b7932 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:55.989574 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-7b518f37-0dc7-4d90-8540-d7dfce3b7932 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:55.990946 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-7b518f37-0dc7-4d90-8540-d7dfce3b7932 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "DELETE /v2.0/security-groups/9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9 HTTP/1.1" status: 204  len: 168 time: 0.1872640
Jun 01 12:43:55.993643 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36238) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:43:56.011035 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7924f9d2-4875-455e-88ac-cfcab36c5b83 None None] New status for floating IP ed705b00-9053-4494-a4c2-691fd296b3ad: DOWN {{(pid=91980) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:43:56.011526 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.api.v2.resource [None req-2b837bf9-721f-4550-9f63-3b5e829acfef tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] show failed (client error): The resource could not be found.
Jun 01 12:43:56.012095 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-2b837bf9-721f-4550-9f63-3b5e829acfef tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "GET /v2.0/security-groups/9b0decec-1f5f-4bbd-b7dc-f21d7c8a1fd9 HTTP/1.1" status: 404  len: 347 time: 0.0164800
Jun 01 12:43:56.015099 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36242) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:43:56.232665 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Deleting port 3132c314-d50b-4088-b8c8-f37cb71dfca2 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:43:56.233092 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:56.350531 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:56.350857 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:56.475761 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Calling delete_port for 3132c314-d50b-4088-b8c8-f37cb71dfca2 owned by network:floatingip {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:43:56.585484 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:56.590781 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-094318a2-b3a8-405d-96a4-e19b23570b52 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:43:56.640148 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Pushing event deleted for resources: {'Port': ['ID=3132c314-d50b-4088-b8c8-f37cb71dfca2,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:43:56.665753 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:43:56.727882 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks [] for floatingip, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:56.741570 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:43:56.742681 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-3b845bb6-225f-4920-b2e9-c4901ab1bbae tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] 10.222.0.81 "DELETE /v2.0/floatingips/ed705b00-9053-4494-a4c2-691fd296b3ad HTTP/1.1" status: 204  len: 168 time: 0.7267084
Jun 01 12:43:57.276974 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:43:57.314658 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 79b6ede7-bda5-4259-8b84-707dcd1fda2e {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:43:57.315009 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 79b6ede7-bda5-4259-8b84-707dcd1fda2e not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:43:59.523735 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36272) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:00.227326 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:00.724687 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Deleting port abab8eea-b119-4add-835f-fd819aeea2ce {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:00.725267 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:00.850165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] For port abab8eea-b119-4add-835f-fd819aeea2ce, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=abab8eea-b119-4add-835f-fd819aeea2ce,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:00.850520 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:00.977456 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Calling delete_port for abab8eea-b119-4add-835f-fd819aeea2ce owned by network:router_interface {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:01.145045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:01.150381 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-720b81c5-42d6-4f58-a6b0-dfa3f807eaaa tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:01.196932 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Pushing event deleted for resources: {'Port': ['ID=abab8eea-b119-4add-835f-fd819aeea2ce,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:01.236381 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:01.469978 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:01.917321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Router 7e176463-91d5-4735-ab79-0ea7c34c6767 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:44:02.101254 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:44:02.109716 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] Sync routers for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:44:02.113753 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-1798ac39-d7fc-4956-ac9e-3465f67d220d admin admin] 10.222.0.81 "PUT /v2.0/routers/7e176463-91d5-4735-ab79-0ea7c34c6767/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5888913
Jun 01 12:44:02.124477 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36286) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:02.124690 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:02.124690 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a26951a00>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:43:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:02.295813 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:02.318945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks [] for router, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:02.495753 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:02.568414 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Deleting port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:02.568782 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:02.612751 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a26951a00>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87'}], 'enable_snat': True}, 'gw_port_id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:44:01Z', 'revision_number': 5, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port': {'id': '9e1ab1d9-1e02-4ae5-97fa-020b06a3870e', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:fe:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'device_owner': 'network:router_gateway', 'standard_attr_id': 522, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:38:05Z', 'updated_at': '2021-06-01T12:38:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:02.616537 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] Checking router: 7e176463-91d5-4735-ab79-0ea7c34c6767 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:44:02.625756 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] Routers {'7e176463-91d5-4735-ab79-0ea7c34c6767'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:02.626359 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a26951a00>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:43:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['7e176463-91d5-4735-ab79-0ea7c34c6767'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:02.689623 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] For port 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:02.690213 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:02.775060 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] Set router 7e176463-91d5-4735-ab79-0ea7c34c6767 gateway port host: None {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:02.810680 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Calling delete_port for 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e owned by network:router_gateway {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:02.878925 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a26951a00>, [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:44:02Z', 'revision_number': 6, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port_host': None}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:02.882937 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575bcfe3-fa23-4df8-b67e-4750521e1963 None None] The sync data for ids ['7e176463-91d5-4735-ab79-0ea7c34c6767'] in dv-cinder-793515-2-iscsi is: [{'id': '7e176463-91d5-4735-ab79-0ea7c34c6767', 'name': 'tempest-AttachVolumeShelveTestJSON-706859706-router', 'tenant_id': 'dc771aee219e4d5d914602852a126ac3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:38:04Z', 'updated_at': '2021-06-01T12:44:02Z', 'revision_number': 6, 'project_id': 'dc771aee219e4d5d914602852a126ac3', 'gw_port_host': None}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:44:02.951365 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:02.954931 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-1c33c6d9-7d43-4a42-aa86-c27719b1d258 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:02.998004 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Pushing event deleted for resources: {'Port': ['ID=9e1ab1d9-1e02-4ae5-97fa-020b06a3870e,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:03.000371 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:03.094629 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.374282 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.376626 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.398140 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.398847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7e176463-91d5-4735-ab79-0ea7c34c6767 {{(pid=91979) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:44:03.410861 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Notify callbacks [] for router, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.411974 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] 10.222.0.81 "DELETE /v2.0/routers/7e176463-91d5-4735-ab79-0ea7c34c6767 HTTP/1.1" status: 204  len: 168 time: 1.2949343
Jun 01 12:44:03.414523 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36294) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:03.476558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_v2 [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Deleting subnet 37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 {{(pid=91979) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:44:03.480212 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.527937 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2204557'] for subnet, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.604502 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.859143 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2610798', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2345669'] for subnet, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.864154 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9ed6a310-7bf4-4fb0-9c9e-6602c35e6b73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:03.898940 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:03.902351 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:03.903613 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:03.908674 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0b42c65-ff8e-4500-9410-836dfff393a4 None None] Network a2f45554-20a3-4b02-a9ad-473554e8b2ed requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:44:03.910053 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/37a7242d-a5ae-413a-bbe0-a4fdd6b0dbd5 HTTP/1.1" status: 204  len: 168 time: 0.4943497
Jun 01 12:44:03.913118 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36298) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:04.025179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.101837 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Deleting port 10374f0b-4126-4956-a5ac-064402357230 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:04.102173 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.185068 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] DHCP port deletion for a2f45554-20a3-4b02-a9ad-473554e8b2ed request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:44:04.209213 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] For port 10374f0b-4126-4956-a5ac-064402357230, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=10374f0b-4126-4956-a5ac-064402357230,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:04.209568 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.257205 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Deleting port 10374f0b-4126-4956-a5ac-064402357230 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:04.257597 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.328116 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:04.337251 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Calling delete_port for 10374f0b-4126-4956-a5ac-064402357230 owned by network:dhcp {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:04.380176 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:04.380445 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 9e1ab1d9-1e02-4ae5-97fa-020b06a3870e not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:04.380898 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 10374f0b-4126-4956-a5ac-064402357230 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:04.388764 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.392765 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:04.424816 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 10374f0b-4126-4956-a5ac-064402357230 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:04.425170 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 10374f0b-4126-4956-a5ac-064402357230 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:04.425591 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device abab8eea-b119-4add-835f-fd819aeea2ce no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:04.434395 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Pushing event deleted for resources: {'Port': ['ID=10374f0b-4126-4956-a5ac-064402357230,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:04.438006 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:04.440812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] No DVR routers for this DVR port 10374f0b-4126-4956-a5ac-064402357230 on host dv-cinder-793515-2-iscsi {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:44:04.467815 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: abab8eea-b119-4add-835f-fd819aeea2ce {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:04.468163 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device abab8eea-b119-4add-835f-fd819aeea2ce not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:04.471958 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] For port 10374f0b-4126-4956-a5ac-064402357230, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=10374f0b-4126-4956-a5ac-064402357230,segment=NetworkSegment(b8b27531-fca1-4879-a221-022c8b3c93f1),segment_id=b8b27531-fca1-4879-a221-022c8b3c93f1)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:04.472344 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.561777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.579055 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a244d04f0>,) {'filters': {'network_id': ['a2f45554-20a3-4b02-a9ad-473554e8b2ed']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:04.591874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a244d04f0>, 'b8b27531-fca1-4879-a221-022c8b3c93f1') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:04.592166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a244d04f0>, 'b8b27531-fca1-4879-a221-022c8b3c93f1') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:04.604637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.605540 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Calling delete_port for 10374f0b-4126-4956-a5ac-064402357230 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:04.622334 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.629276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Releasing vlan 756 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:44:04.629714 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:44:04.642854 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:44:04.653284 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.657093 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:04.701691 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Pushing event deleted for resources: {'Port': ['ID=10374f0b-4126-4956-a5ac-064402357230,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:04.704695 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:04.705475 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] No DVR routers for this DVR port 10374f0b-4126-4956-a5ac-064402357230 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:44:04.719084 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.722709 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:04.739637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:04.834514 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Pushing event deleted for resources: {'Network': ['ID=a2f45554-20a3-4b02-a9ad-473554e8b2ed,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:04.837787 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:04.848721 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] 10.222.0.81 "DELETE /v2.0/networks/a2f45554-20a3-4b02-a9ad-473554e8b2ed HTTP/1.1" status: 204  len: 168 time: 0.9345918
Jun 01 12:44:04.962577 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36306) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:05.011381 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6420e63c-d83b-4278-9163-41d1a97c1438 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=dc771aee219e4d5d914602852a126ac3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0468435
Jun 01 12:44:05.013730 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36310) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:05.071699 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d754de8-59d4-4eb6-8a31-9e1488e444e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:05.098105 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d754de8-59d4-4eb6-8a31-9e1488e444e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:05.150335 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d754de8-59d4-4eb6-8a31-9e1488e444e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:05.154040 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e4e54488-a4b0-4430-b9f4-784494d45be4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:05.168010 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d754de8-59d4-4eb6-8a31-9e1488e444e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07eb3726-dcc5-496f-a9c4-76722dc43ebf,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:05.171911 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-4d754de8-59d4-4eb6-8a31-9e1488e444e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:05.175146 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-4d754de8-59d4-4eb6-8a31-9e1488e444e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:05.176299 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-4d754de8-59d4-4eb6-8a31-9e1488e444e6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/07eb3726-dcc5-496f-a9c4-76722dc43ebf HTTP/1.1" status: 204  len: 168 time: 0.1616218
Jun 01 12:44:05.918295 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36340) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:06.028385 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-385519852-network', 'tenant_id': 'b6d1ef7d540a43c6869c7fa1a0838204'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:06.033702 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:44:06.037749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Usage tracker for resource:network and tenant:b6d1ef7d540a43c6869c7fa1a0838204 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:44:06.040871 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:44:06.047366 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:44:06.057385 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Made reservation on behalf of b6d1ef7d540a43c6869c7fa1a0838204 for: {'network': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:44:06.060409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-970524'] for network, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.076202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.090164 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:44:06.094159 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Usage tracker for resource:security_group_rule and tenant:b6d1ef7d540a43c6869c7fa1a0838204 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:44:06.097121 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:44:06.102984 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:44:06.188895 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.192844 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.195653 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b8a0139f-3ff1-4048-b7fd-10d336fdb9dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:06.223302 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] vlan segment allocate from pool success with {'vlan_id': 787, 'physical_network': 'physnet1'}  {{(pid=91979) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
Jun 01 12:44:06.232463 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eac69940-43b4-4194-a655-6a2e5c9315d3,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:06.236082 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:06.238686 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.239023 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.segments_db [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Added segment d1342ba0-ad42-4b56-b918-8a0cd523c367 of type vlan for network 4c119a34-b195-4741-b131-afc7d89e3c41
Jun 01 12:44:06.266019 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8760163405635'] for network, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.295544 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961'] for network, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.296871 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:06.297451 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.300841 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8358dcb3-12bc-4cc7-bc0e-0695088b137c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:06.402557 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Pushing event updated for resources: {'Network': ['ID=4c119a34-b195-4741-b131-afc7d89e3c41,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:06.405558 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.4862645
Jun 01 12:44:06.406532 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:06.408597 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36346) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:06.412453 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Network 4c119a34-b195-4741-b131-afc7d89e3c41 details requested by agent ovs-agent-dv-cinder-793515-2-iscsi with host dv-cinder-793515-2-iscsi {{(pid=91980) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
Jun 01 12:44:06.414106 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Request body: {'subnet': {'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-385519852-subnet', 'tenant_id': 'b6d1ef7d540a43c6869c7fa1a0838204', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:06.418997 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:44:06.422939 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Usage tracker for resource:subnet and tenant:b6d1ef7d540a43c6869c7fa1a0838204 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:44:06.425830 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:44:06.431576 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:44:06.441878 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Made reservation on behalf of b6d1ef7d540a43c6869c7fa1a0838204 for: {'subnet': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:44:06.444175 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2345690'] for subnet, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.842422 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2610733', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2345676'] for subnet, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.845971 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3970bc97-5962-4340-a267-e00cf66ef9c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:06.913670 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Pushing event updated for resources: {'Subnet': ['ID=efb47d96-d48f-48ad-9699-a0a2eb0a84b2,revision_number=0']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:06.916441 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:06.925596 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Checking segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:44:06.925950 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Network hostable DHCP agents. Network: 4c119a34-b195-4741-b131-afc7d89e3c41, hostable agents: ['333bc347-139f-41dc-b883-59003c19b9ef'], hosted agents: [] {{(pid=91979) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
Jun 01 12:44:06.944449 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Network 4c119a34-b195-4741-b131-afc7d89e3c41 is scheduled to be hosted by DHCP agent 333bc347-139f-41dc-b883-59003c19b9ef with binding_index 1 {{(pid=91979) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
Jun 01 12:44:06.954093 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-793515-2-iscsi, 4c119a34-b195-4741-b131-afc7d89e3c41) {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:44:06.962534 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:06.963125 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:06.964020 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b41ffa7-cfc7-4956-92b0-8da3a7e5758d None None] Network 4c119a34-b195-4741-b131-afc7d89e3c41 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:44:06.991664 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-da1f7d94-8a00-4e65-9fc9-541a3c0c0d3e admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 0.5745559
Jun 01 12:44:07.196121 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a02cdb4-168e-437a-87a2-3cd0da4cf0fe None None] Network 4c119a34-b195-4741-b131-afc7d89e3c41 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:44:07.497258 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-f4ba1389-e97e-46b0-af28-8f52de864870 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:07.498678 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-f4ba1389-e97e-46b0-af28-8f52de864870 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.1463575
Jun 01 12:44:07.512905 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-6d89c01b-c924-4bc8-aa5d-57589ef8d5d2 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/quotas/b6d1ef7d540a43c6869c7fa1a0838204 HTTP/1.1" status: 200  len: 375 time: 0.0087829
Jun 01 12:44:07.559821 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-c43a6006-e440-47fd-abd3-eb635c87f511 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0418582
Jun 01 12:44:07.689363 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-93a4b3a9-c0bd-43ae-95cd-b0bc90de6f34 service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1225998
Jun 01 12:44:07.819100 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-cd74be3c-6909-4370-9f07-d6df0014fd8d service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1238251
Jun 01 12:44:08.011224 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-526c1fb0-ce58-49cd-8f29-c785f108ce0b req-f159c0a5-f73e-49dc-8362-20cb186992a0 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 210 time: 0.0476592
Jun 01 12:44:09.165351 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b61c44d1-c089-48b0-9477-1e4d3cfadbc2 req-a76abcb9-5fef-43bb-8a0e-1a3f2d24377f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 210 time: 0.0423713
Jun 01 12:44:09.576569 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-9383739c-4dd8-4273-b4f2-18d997dabfa2 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:09.577255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-9383739c-4dd8-4273-b4f2-18d997dabfa2 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:network {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:09.594679 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-9383739c-4dd8-4273-b4f2-18d997dabfa2 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:network {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:09.595990 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-9383739c-4dd8-4273-b4f2-18d997dabfa2 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.1690564
Jun 01 12:44:09.608645 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Request body: {'port': {'device_id': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'admin_state_up': True, 'tenant_id': 'b6d1ef7d540a43c6869c7fa1a0838204'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:09.750717 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:44:09.754430 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Usage tracker for resource:port and tenant:b6d1ef7d540a43c6869c7fa1a0838204 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:44:09.757188 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:44:09.762749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:44:09.771856 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Made reservation on behalf of b6d1ef7d540a43c6869c7fa1a0838204 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:44:09.775347 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:09.847788 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-fcba6972-2270-4198-9b3b-cd679a0d7c0c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:09.943823 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Allocated IP 172.20.0.4 (4c119a34-b195-4741-b131-afc7d89e3c41/efb47d96-d48f-48ad-9699-a0a2eb0a84b2/b9b80ed8-675e-4b51-841b-3ea3c15637df) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:44:10.177805 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:10.208207 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:10.214646 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c13be0d4-64b4-430c-9bfd-060224341234 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:10.281158 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Network 4c119a34-b195-4741-b131-afc7d89e3c41 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:44:10.408783 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:44:10.422445 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:44:10.458992 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event updated for resources: {'Port': ['ID=b9b80ed8-675e-4b51-841b-3ea3c15637df,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:10.469241 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:10.504247 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:10.504904 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:10.531766 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9267695
Jun 01 12:44:10.540203 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d59d7d-262a-4036-87e6-4e2406f21d2a req-cdf8d86b-3c8c-4aab-bbc7-844cf064107a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:10.540927 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-91d59d7d-262a-4036-87e6-4e2406f21d2a req-cdf8d86b-3c8c-4aab-bbc7-844cf064107a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:10.548614 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Request body: {'port': {'device_id': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:10.612096 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-91d59d7d-262a-4036-87e6-4e2406f21d2a req-cdf8d86b-3c8c-4aab-bbc7-844cf064107a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:10.613288 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-91d59d7d-262a-4036-87e6-4e2406f21d2a req-cdf8d86b-3c8c-4aab-bbc7-844cf064107a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 931 time: 0.3372655
Jun 01 12:44:10.702916 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:10.722790 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-91d59d7d-262a-4036-87e6-4e2406f21d2a req-6c95c7e5-c6ba-4e74-a54e-bbfd68d506bf tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:security_group {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:10.784790 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-91d59d7d-262a-4036-87e6-4e2406f21d2a req-6c95c7e5-c6ba-4e74-a54e-bbfd68d506bf tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:security_group {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:10.785908 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-91d59d7d-262a-4036-87e6-4e2406f21d2a req-6c95c7e5-c6ba-4e74-a54e-bbfd68d506bf tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1449661
Jun 01 12:44:11.066014 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b9b80ed8-675e-4b51-841b-3ea3c15637df {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:44:11.073530 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:11.089202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Transition to ACTIVE for port object b9b80ed8-675e-4b51-841b-3ea3c15637df will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:44:11.093533 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:11.097406 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7fd3def3-5041-46a2-9e8f-c92fa93cb567 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:11.223384 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Pushing event updated for resources: {'Port': ['ID=b9b80ed8-675e-4b51-841b-3ea3c15637df,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:11.254424 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:11.330191 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Attempting to bind port b9b80ed8-675e-4b51-841b-3ea3c15637df on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:44:11.330440 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Attempting to bind port b9b80ed8-675e-4b51-841b-3ea3c15637df by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:44:11.330776 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Attempting to bind port b9b80ed8-675e-4b51-841b-3ea3c15637df on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:44:11.335470 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Port b9b80ed8-675e-4b51-841b-3ea3c15637df on network 4c119a34-b195-4741-b131-afc7d89e3c41 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:44:11.335791 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Attempting to bind port b9b80ed8-675e-4b51-841b-3ea3c15637df on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:44:11.342073 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 43, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:44:11.342431 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Checking segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:44:11.342812 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Bound using segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:44:11.343261 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Bound port: b9b80ed8-675e-4b51-841b-3ea3c15637df, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:44:11.343617 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:11.436502 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] For port b9b80ed8-675e-4b51-841b-3ea3c15637df, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:44:11.439633 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] For port b9b80ed8-675e-4b51-841b-3ea3c15637df, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:44:11.444012 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:11.447814 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-f50c8cfd-b2dd-4bcc-9aeb-62fc05926dff tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:11.506712 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:11.507165 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:11.508500 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-8463864f-f015-4190-9e62-8314102fff22 service neutron] 10.222.0.95 "PUT /v2.0/ports/b9b80ed8-675e-4b51-841b-3ea3c15637df HTTP/1.1" status: 200  len: 1093 time: 0.9648991
Jun 01 12:44:11.512009 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'tag': 'b9b80ed8-675e-4b51-841b-3ea3c15637df'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:11.516060 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-503c044e-5fc3-4b2d-8157-a8985e604302" -d '{"events": [{"name": "network-changed", "server_uuid": "6ea67e11-a8c6-41ef-9270-1aa43840c870", "tag": "b9b80ed8-675e-4b51-841b-3ea3c15637df"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:11.547255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Pushing event updated for resources: {'Port': ['ID=b9b80ed8-675e-4b51-841b-3ea3c15637df,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:11.601598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:11.603344 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4090442d-3c7c-4c8d-9c8a-8fc40170acde x-openstack-request-id: req-4090442d-3c7c-4c8d-9c8a-8fc40170acde {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:11.603663 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6ea67e11-a8c6-41ef-9270-1aa43840c870", "tag": "b9b80ed8-675e-4b51-841b-3ea3c15637df", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:11.603980 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-4090442d-3c7c-4c8d-9c8a-8fc40170acde {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:11.604388 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'tag': 'b9b80ed8-675e-4b51-841b-3ea3c15637df', 'status': 'completed', 'code': 200}
Jun 01 12:44:11.643936 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-a7bcb330-ea4e-41a3-9aa9-3a8699e2a11b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:11.645479 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-a7bcb330-ea4e-41a3-9aa9-3a8699e2a11b service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 1096 time: 0.0936508
Jun 01 12:44:11.717223 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-78fa2085-43f4-463e-9a52-7b5fca8f46ad service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df HTTP/1.1" status: 200  len: 217 time: 0.0631936
Jun 01 12:44:11.779901 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-733bfa06-e65b-4ef5-a5ec-e08f844db1c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:11.781433 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-733bfa06-e65b-4ef5-a5ec-e08f844db1c3 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.0572779
Jun 01 12:44:11.830202 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-e69f473e-3437-41ab-86f1-0d60eb48dc53 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0417223
Jun 01 12:44:12.020659 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-b219c048-9a2d-4690-8c06-262b2c37953b service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1811154
Jun 01 12:44:12.061434 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bd0cf2-9e74-4f28-aa90-19509d04ff02 req-00d9d5e8-be60-4eea-b5d6-777e6206015a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:12.062886 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b5bd0cf2-9e74-4f28-aa90-19509d04ff02 req-00d9d5e8-be60-4eea-b5d6-777e6206015a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 943 time: 0.1542795
Jun 01 12:44:12.162995 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:12.282192 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-b5bd0cf2-9e74-4f28-aa90-19509d04ff02 req-c73f6905-4c8c-49ba-82a1-4fdf078e2828 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0713654
Jun 01 12:44:12.305892 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e238c0ab-b952-4b08-a69d-5fb80dd4f83d req-5b82ae04-28c8-42d1-a58a-1820bd756f1b service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2757006
Jun 01 12:44:12.345130 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:12.472544 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-6396e8c1-0eba-4146-a71b-59c8514f2272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:12.474009 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-6396e8c1-0eba-4146-a71b-59c8514f2272 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 1096 time: 0.0993042
Jun 01 12:44:12.619170 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-c0057c84-6342-4405-a986-ea3748cb883b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:12.621065 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-c0057c84-6342-4405-a986-ea3748cb883b service neutron] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 915 time: 0.1395710
Jun 01 12:44:12.684300 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-5db4eab5-f02d-466a-83a0-0171a0a82bc2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:12.695429 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-c4c141dc-542e-4f84-b34b-1e548c0d23f4 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df HTTP/1.1" status: 200  len: 217 time: 0.0653946
Jun 01 12:44:12.767986 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-600661e2-028f-4e87-806c-832059874ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:12.769566 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-600661e2-028f-4e87-806c-832059874ee2 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.0672724
Jun 01 12:44:12.819719 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-f978acf2-479b-4568-a990-c78dfd5c6b2d service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0426002
Jun 01 12:44:12.962752 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-bfd44c67-bc8f-46a0-929c-6791c3311bdd service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1334882
Jun 01 12:44:13.108371 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-503c044e-5fc3-4b2d-8157-a8985e604302 req-f65b8875-abd0-4738-9a78-b038c2c1df08 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1383126
Jun 01 12:44:13.384099 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device b9b80ed8-675e-4b51-841b-3ea3c15637df details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:44:13.499031 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f1894c6-d1b1-438c-b9da-1c0c0a1a4cfe req-7bd339a3-cc33-4dee-9b95-00cffa05020d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:13.501331 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0f1894c6-d1b1-438c-b9da-1c0c0a1a4cfe req-7bd339a3-cc33-4dee-9b95-00cffa05020d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 943 time: 0.0957756
Jun 01 12:44:13.524268 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port b9b80ed8-675e-4b51-841b-3ea3c15637df, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:13.540289 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'b9b80ed8-675e-4b51-841b-3ea3c15637df', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'port_id': 'b9b80ed8-675e-4b51-841b-3ea3c15637df', 'mac_address': 'fa:16:3e:50:88:4c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 787, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'efb47d96-d48f-48ad-9699-a0a2eb0a84b2', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:44:13.553596 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0f1894c6-d1b1-438c-b9da-1c0c0a1a4cfe req-aa6fff11-9a2a-4cfb-b53f-785b9cb1e994 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442538
Jun 01 12:44:13.601548 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:13.618499 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b9b80ed8-675e-4b51-841b-3ea3c15637df {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:44:13.634901 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port b9b80ed8-675e-4b51-841b-3ea3c15637df, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:13.640183 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:13.642000 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-90cd4c19-6136-4fa8-9148-6b0a3116b7ec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:13.710251 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=b9b80ed8-675e-4b51-841b-3ea3c15637df,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:13.713525 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:13.877897 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:44:13.922597 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:14.745671 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c41bfd-96fd-4338-8724-5aa1497bfb90 req-73a74a69-c8f8-49aa-9a97-1481939b2c87 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:14.747203 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b1c41bfd-96fd-4338-8724-5aa1497bfb90 req-73a74a69-c8f8-49aa-9a97-1481939b2c87 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 944 time: 0.0824363
Jun 01 12:44:14.792351 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b1c41bfd-96fd-4338-8724-5aa1497bfb90 req-754894c1-f5b8-4704-8c03-8f61a1e19f6b tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392935
Jun 01 12:44:15.333419 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5da44c0b-8b68-44aa-b9c2-7cbf758830e9 req-048d1fa9-ff64-43fc-a859-c51024064444 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:15.334864 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5da44c0b-8b68-44aa-b9c2-7cbf758830e9 req-048d1fa9-ff64-43fc-a859-c51024064444 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 945 time: 0.0827880
Jun 01 12:44:15.379867 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5da44c0b-8b68-44aa-b9c2-7cbf758830e9 req-f1288e9b-68d2-40b3-8c4d-2101c224e1fd tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387108
Jun 01 12:44:15.412881 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device b9b80ed8-675e-4b51-841b-3ea3c15637df up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:44:15.473121 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:15.490241 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port b9b80ed8-675e-4b51-841b-3ea3c15637df completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:44:15.494935 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port b9b80ed8-675e-4b51-841b-3ea3c15637df triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:44:15.495959 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:15.612153 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:15.639796 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9b80ed8-675e-4b51-841b-3ea3c15637df'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:15.642019 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-855bbf65-5890-4e22-acd8-62b3ce9b8cdd" -d '{"events": [{"server_uuid": "6ea67e11-a8c6-41ef-9270-1aa43840c870", "name": "network-vif-plugged", "status": "completed", "tag": "b9b80ed8-675e-4b51-841b-3ea3c15637df"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:15.649400 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port b9b80ed8-675e-4b51-841b-3ea3c15637df, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:15.653072 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:15.654880 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-c3c95b4c-0cef-4d5c-9f43-244e3b47e804 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:15.689388 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ae5dbe8-5013-46fa-aeef-393655ddaa83 x-openstack-request-id: req-7ae5dbe8-5013-46fa-aeef-393655ddaa83 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:15.689685 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6ea67e11-a8c6-41ef-9270-1aa43840c870", "name": "network-vif-plugged", "status": "completed", "tag": "b9b80ed8-675e-4b51-841b-3ea3c15637df", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:15.690199 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-7ae5dbe8-5013-46fa-aeef-393655ddaa83 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:15.690588 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b9b80ed8-675e-4b51-841b-3ea3c15637df', 'code': 200}
Jun 01 12:44:15.725236 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=b9b80ed8-675e-4b51-841b-3ea3c15637df,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:15.728742 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:15.916573 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025f3aae-83a6-4466-a7ff-c0e65b2033c6 req-a242cc1f-1f9d-4550-9b2f-ef5fb72d3f6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:15.917983 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-025f3aae-83a6-4466-a7ff-c0e65b2033c6 req-a242cc1f-1f9d-4550-9b2f-ef5fb72d3f6f service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 1098 time: 0.0688529
Jun 01 12:44:15.966994 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-025f3aae-83a6-4466-a7ff-c0e65b2033c6 req-4a3bc2cd-a99a-45ee-8b44-4702003c3704 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403197
Jun 01 12:44:15.982730 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58520a00-0eb2-4ccc-bca4-c1502c972ddf req-8d7a9e54-9939-42c6-995f-32bdcf88580f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:15.984158 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-58520a00-0eb2-4ccc-bca4-c1502c972ddf req-8d7a9e54-9939-42c6-995f-32bdcf88580f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 945 time: 0.0861971
Jun 01 12:44:16.032036 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-58520a00-0eb2-4ccc-bca4-c1502c972ddf req-6c187cac-dade-4b84-84bd-f017e6517cb3 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422442
Jun 01 12:44:16.569088 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa24ce9-c663-4cb1-abfc-9f89906137a5 req-41228480-4638-438a-a986-918fb7ee0640 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:16.570446 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5aa24ce9-c663-4cb1-abfc-9f89906137a5 req-41228480-4638-438a-a986-918fb7ee0640 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 945 time: 0.0803940
Jun 01 12:44:16.614467 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5aa24ce9-c663-4cb1-abfc-9f89906137a5 req-2bf6abea-febb-494f-89f8-f772dd38d075 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/security-groups?id=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383742
Jun 01 12:44:16.988213 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-1f521157-b044-46ce-9802-11dc9260d4da tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:16.989727 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-1f521157-b044-46ce-9802-11dc9260d4da tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 945 time: 0.0881143
Jun 01 12:44:17.128036 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Deleting port 9d7bf369-9226-479c-9da9-1271f74f5b42 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:17.128480 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:17.217543 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4b2490-4e6c-4d6b-b301-5c559aedc5bf req-87e43ae7-545c-4454-88d8-2509a82b32c4 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:17.219013 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0a4b2490-4e6c-4d6b-b301-5c559aedc5bf req-87e43ae7-545c-4454-88d8-2509a82b32c4 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 945 time: 0.0801311
Jun 01 12:44:17.261453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] For port 9d7bf369-9226-479c-9da9-1271f74f5b42, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=9d7bf369-9226-479c-9da9-1271f74f5b42,segment=NetworkSegment(0639fdd3-7524-43ac-8e87-bab2babae079),segment_id=0639fdd3-7524-43ac-8e87-bab2babae079)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:17.261705 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:17.263313 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-0a4b2490-4e6c-4d6b-b301-5c559aedc5bf req-a0391acb-1fd4-4aec-9c15-3c00fe712d71 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385494
Jun 01 12:44:17.394872 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Calling delete_port for 9d7bf369-9226-479c-9da9-1271f74f5b42 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:17.507610 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:17.513860 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-7a4cdaac-abea-4a82-8890-e68c012c6e52 tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:17.657731 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Pushing event deleted for resources: {'Port': ['ID=9d7bf369-9226-479c-9da9-1271f74f5b42,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:17.661439 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:17.738948 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] No DVR routers for this DVR port 9d7bf369-9226-479c-9da9-1271f74f5b42 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:44:17.742729 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:17.746095 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '189976fe-f830-4f9a-b107-aabdb6275028', 'name': 'network-vif-deleted', 'tag': '9d7bf369-9226-479c-9da9-1271f74f5b42'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:17.748308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd23227f-5cf2-4949-baae-92f613daff28" -d '{"events": [{"server_uuid": "189976fe-f830-4f9a-b107-aabdb6275028", "name": "network-vif-deleted", "tag": "9d7bf369-9226-479c-9da9-1271f74f5b42"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:17.798119 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6da5929-22e0-45f5-9dbe-b9e5e329a109 x-openstack-request-id: req-b6da5929-22e0-45f5-9dbe-b9e5e329a109 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:17.798444 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "189976fe-f830-4f9a-b107-aabdb6275028", "name": "network-vif-deleted", "tag": "9d7bf369-9226-479c-9da9-1271f74f5b42", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:17.798777 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-b6da5929-22e0-45f5-9dbe-b9e5e329a109 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:17.799201 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '189976fe-f830-4f9a-b107-aabdb6275028', 'name': 'network-vif-deleted', 'tag': '9d7bf369-9226-479c-9da9-1271f74f5b42', 'status': 'completed', 'code': 200}
Jun 01 12:44:17.808181 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-cf75baf1-4d63-4247-8bdc-9e4aeb4924c9 req-e060e0b2-107d-4046-9dc6-0d1196a49330 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Synchronizing usage tracker for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:17.811582 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6a35d610-be42-4f87-8369-9642e43be2f7 req-fa26c1f6-79b9-4d84-8727-291457cf591d tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.95 "DELETE /v2.0/ports/9d7bf369-9226-479c-9da9-1271f74f5b42 HTTP/1.1" status: 204  len: 173 time: 0.8144553
Jun 01 12:44:17.826360 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-cf75baf1-4d63-4247-8bdc-9e4aeb4924c9 req-e060e0b2-107d-4046-9dc6-0d1196a49330 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Unset dirty status for tenant:5a84a76793e14c6f80e91f0ce9a6e26e on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:17.827503 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cf75baf1-4d63-4247-8bdc-9e4aeb4924c9 req-e060e0b2-107d-4046-9dc6-0d1196a49330 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] 10.222.0.81 "GET /v2.0/ports?device_id=189976fe-f830-4f9a-b107-aabdb6275028 HTTP/1.1" status: 200  len: 210 time: 0.0866728
Jun 01 12:44:19.437926 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9d7bf369-9226-479c-9da9-1271f74f5b42 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:19.472146 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 9d7bf369-9226-479c-9da9-1271f74f5b42 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:19.472490 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 9d7bf369-9226-479c-9da9-1271f74f5b42 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:20.879432 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:44:26.312288 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-c2d6c65e-255c-4b2a-9b57-206bce9d420d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:26.313793 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-c2d6c65e-255c-4b2a-9b57-206bce9d420d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.1481099
Jun 01 12:44:26.329398 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-1664e6b9-6ce4-4b41-8c06-c12398a3ed94 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/quotas/b6d1ef7d540a43c6869c7fa1a0838204 HTTP/1.1" status: 200  len: 375 time: 0.0097823
Jun 01 12:44:26.409296 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-07dc533a-0305-4063-8316-62b4329c0511 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&fields=id HTTP/1.1" status: 200  len: 255 time: 0.0746586
Jun 01 12:44:26.420334 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-04846efe-4d2f-4f15-8e5f-7b2454076a4f service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91979) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:44:26.421280 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-04846efe-4d2f-4f15-8e5f-7b2454076a4f service neutron] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0056825
Jun 01 12:44:26.563257 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-55eab9a9-3da8-435c-908e-6c9df01b4196 service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1365020
Jun 01 12:44:26.698800 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-05df8412-a61c-46dd-b060-d78a48bba0db service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1295395
Jun 01 12:44:26.990312 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-663d62cf-6470-42f4-83f1-a059b2c6cb7f req-a9a68ae7-2908-441e-8c92-8711e257ff8f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 210 time: 0.1118996
Jun 01 12:44:28.047943 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-225cf4f3-9cf0-45bc-98f8-38dfeaa238b0 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:28.049477 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-225cf4f3-9cf0-45bc-98f8-38dfeaa238b0 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.1813171
Jun 01 12:44:28.065904 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Request body: {'port': {'device_id': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'admin_state_up': True, 'tenant_id': 'b6d1ef7d540a43c6869c7fa1a0838204'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:28.219019 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5ecb2b63-3531-45bb-a557-7e4e16798a3d req-fc5bd30c-b350-4eaa-b9d5-d1d40785f5e4 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 210 time: 0.0638182
Jun 01 12:44:28.279021 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:44:28.305660 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:44:28.321925 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Made reservation on behalf of b6d1ef7d540a43c6869c7fa1a0838204 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:44:28.328102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:28.516121 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Allocated IP 172.20.0.7 (4c119a34-b195-4741-b131-afc7d89e3c41/efb47d96-d48f-48ad-9699-a0a2eb0a84b2/1fa74d48-8b7c-46a0-912d-7e4406c1a30d) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:44:28.729877 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:28.760459 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:28.766747 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8463864f-f015-4190-9e62-8314102fff22 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:28.772171 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:44:28.831527 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Network 4c119a34-b195-4741-b131-afc7d89e3c41 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:44:28.834814 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:44:28.838768 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:44:28.884655 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event updated for resources: {'Port': ['ID=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:28.891150 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:28.913124 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:28.913749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:28.941257 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-b8aa7613-4ac6-4357-b846-fa94016a8c19 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.8817339
Jun 01 12:44:28.956238 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Request body: {'port': {'device_id': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:29.070695 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:29.427160 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8466103d-b10d-47ec-8e3b-5b7de4866db4 req-a698fcf7-429c-42f8-bdd6-87fd47ac5a62 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:29.428867 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8466103d-b10d-47ec-8e3b-5b7de4866db4 req-a698fcf7-429c-42f8-bdd6-87fd47ac5a62 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 931 time: 0.0883930
Jun 01 12:44:29.477963 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8466103d-b10d-47ec-8e3b-5b7de4866db4 req-4eeccb1c-3cfc-45e6-9ef1-591c62fb5ff9 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433233
Jun 01 12:44:29.559499 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1fa74d48-8b7c-46a0-912d-7e4406c1a30d {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:44:29.567222 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:29.582118 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Transition to ACTIVE for port object 1fa74d48-8b7c-46a0-912d-7e4406c1a30d will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:44:29.586395 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:29.590643 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c9d2daa2-876f-4f26-a69a-b83002627b55 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:29.756817 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Pushing event updated for resources: {'Port': ['ID=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:29.759779 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:29.844272 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Attempting to bind port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:44:29.844568 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Attempting to bind port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:44:29.844894 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Attempting to bind port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:44:29.849829 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d on network 4c119a34-b195-4741-b131-afc7d89e3c41 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:44:29.850146 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Attempting to bind port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:44:29.855784 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 44, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:44:29.856110 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Checking segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:44:29.856488 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Bound using segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:44:29.856943 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Bound port: 1fa74d48-8b7c-46a0-912d-7e4406c1a30d, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:44:29.857281 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:29.947847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] For port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:44:29.951478 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] For port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:44:29.955780 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:29.959389 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-636b23fe-171a-4249-a01c-d3707c40508c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:30.018080 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:30.018206 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:30.019720 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] 10.222.0.95 "PUT /v2.0/ports/1fa74d48-8b7c-46a0-912d-7e4406c1a30d HTTP/1.1" status: 200  len: 1093 time: 1.0678756
Jun 01 12:44:30.022604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'tag': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:30.025723 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2476b79-f044-4088-8992-169d45abdf25" -d '{"events": [{"name": "network-changed", "server_uuid": "d4b4b549-909c-441d-96cc-af20fa66dd25", "tag": "1fa74d48-8b7c-46a0-912d-7e4406c1a30d"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:30.048710 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Pushing event updated for resources: {'Port': ['ID=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:30.051911 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:30.109570 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08956af6-ecd6-4eb9-ab62-0f2b06f2e031 x-openstack-request-id: req-08956af6-ecd6-4eb9-ab62-0f2b06f2e031 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:30.110272 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d4b4b549-909c-441d-96cc-af20fa66dd25", "tag": "1fa74d48-8b7c-46a0-912d-7e4406c1a30d", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:30.110272 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-08956af6-ecd6-4eb9-ab62-0f2b06f2e031 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:30.110576 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'tag': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', 'status': 'completed', 'code': 200}
Jun 01 12:44:30.146527 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-674b2122-cee0-495a-b2b1-2d5a3a8d9c8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:30.147988 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-674b2122-cee0-495a-b2b1-2d5a3a8d9c8d service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 1096 time: 0.0857067
Jun 01 12:44:30.673209 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5881ff0c-5174-4df0-a9f7-09c38e14fbde req-91342454-4d90-493e-9dbf-dfb46dbaf796 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:30.675497 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5881ff0c-5174-4df0-a9f7-09c38e14fbde req-91342454-4d90-493e-9dbf-dfb46dbaf796 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 943 time: 0.0895047
Jun 01 12:44:30.723404 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5881ff0c-5174-4df0-a9f7-09c38e14fbde req-e778d74c-7aaa-4910-a1fb-c3c0d79750c3 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419555
Jun 01 12:44:31.921840 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db615ad8-71ca-4b50-be06-1417f1616145 req-7cc211b7-b5b0-4c5a-80ec-190d590da356 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:31.922460 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-db615ad8-71ca-4b50-be06-1417f1616145 req-7cc211b7-b5b0-4c5a-80ec-190d590da356 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:31.990262 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-2a6e505c-817f-4dcf-812c-a301407306df service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1fa74d48-8b7c-46a0-912d-7e4406c1a30d HTTP/1.1" status: 200  len: 217 time: 0.0649457
Jun 01 12:44:31.999252 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-db615ad8-71ca-4b50-be06-1417f1616145 req-7cc211b7-b5b0-4c5a-80ec-190d590da356 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:32.000483 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-db615ad8-71ca-4b50-be06-1417f1616145 req-7cc211b7-b5b0-4c5a-80ec-190d590da356 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 943 time: 0.1648066
Jun 01 12:44:32.046703 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-db615ad8-71ca-4b50-be06-1417f1616145 req-d23c3480-1872-46d5-991d-3515c9366e29 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401423
Jun 01 12:44:32.453006 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36568) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:32.725663 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Deleting port 15c52b37-f38a-4e9c-9a28-2dadc003d92d {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:32.726000 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:32.851079 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:32.851399 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:33.012244 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Calling delete_port for 15c52b37-f38a-4e9c-9a28-2dadc003d92d owned by network:floatingip {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:33.055793 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-de9ea40a-ce1f-4aa7-91b7-b8dc318ab614 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:33.057270 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-de9ea40a-ce1f-4aa7-91b7-b8dc318ab614 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.0814948
Jun 01 12:44:33.214714 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-aa4cd275-d2b2-451d-8979-25e527840830 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1479595
Jun 01 12:44:33.230650 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-e9d55fbb-7d0c-4667-afa6-fcb0a6dc110e service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91979) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:44:33.231761 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-e9d55fbb-7d0c-4667-afa6-fcb0a6dc110e service neutron] 10.222.0.95 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0070727
Jun 01 12:44:33.263815 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bd02543-2f3b-46bd-a5a2-e73c384592fe req-a60ff00d-073c-47bb-8728-975d25c6400c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:33.265462 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5bd02543-2f3b-46bd-a5a2-e73c384592fe req-a60ff00d-073c-47bb-8728-975d25c6400c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 943 time: 0.0988986
Jun 01 12:44:33.316629 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5bd02543-2f3b-46bd-a5a2-e73c384592fe req-9722cb39-a86f-4c2d-959b-3171d2f81d35 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433478
Jun 01 12:44:33.426438 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:33.432338 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-56794535-cab4-4df9-94c9-9d6f9f3b0360 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:33.465340 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-2af11307-3c60-43e7-b4b0-040eac0cbcb5 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2218788
Jun 01 12:44:33.514161 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event deleted for resources: {'Port': ['ID=15c52b37-f38a-4e9c-9a28-2dadc003d92d,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:33.552223 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:33.722634 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:33.722951 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Floating IP 6c4f2780-5e73-457f-b7c3-3364e830961c disassociated (deleted). External IP: 172.27.3.75, port: f134ab33-87e8-442b-8165-d6bba1a217db.
Jun 01 12:44:33.812872 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-a7e23fec-226e-4e81-980a-db38c4e16a36 req-8731cc8d-9e70-4228-adf2-7bc8b90b4056 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3379445
Jun 01 12:44:34.206452 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2476b79-f044-4088-8992-169d45abdf25 req-bb87d506-10fc-403d-9f09-82275476ef83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:34.207952 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c2476b79-f044-4088-8992-169d45abdf25 req-bb87d506-10fc-403d-9f09-82275476ef83 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 1096 time: 0.3177905
Jun 01 12:44:34.215652 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:44:34.580272 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2476b79-f044-4088-8992-169d45abdf25 req-6815bb81-24ec-40d0-8cdf-93857deff2ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:34.581853 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c2476b79-f044-4088-8992-169d45abdf25 req-6815bb81-24ec-40d0-8cdf-93857deff2ff service neutron] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 915 time: 0.3648477
Jun 01 12:44:34.814017 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c2476b79-f044-4088-8992-169d45abdf25 req-67e803ac-e4cd-413c-b24e-47e7be23840e service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1fa74d48-8b7c-46a0-912d-7e4406c1a30d HTTP/1.1" status: 200  len: 217 time: 0.2248309
Jun 01 12:44:34.816085 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:44:34.826258 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:44:34.836906 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:34.837531 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25084a30>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:34.899092 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:34.960073 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2476b79-f044-4088-8992-169d45abdf25 req-58cc8b7d-622b-4dbb-a52f-d6d5bd219f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:34.961562 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c2476b79-f044-4088-8992-169d45abdf25 req-58cc8b7d-622b-4dbb-a52f-d6d5bd219f32 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.1386039
Jun 01 12:44:34.969792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e23c8453-8eeb-4121-ac73-25386870a170 req-f92a6f84-40f6-4cbf-b1dd-81c31432cac1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:34.971591 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e23c8453-8eeb-4121-ac73-25386870a170 req-f92a6f84-40f6-4cbf-b1dd-81c31432cac1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 943 time: 0.5008900
Jun 01 12:44:35.037979 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c2476b79-f044-4088-8992-169d45abdf25 req-6eb25c2a-64fa-4af5-ac65-971519c8ee94 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0654044
Jun 01 12:44:35.042940 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-2e2897bd-d5a4-45f2-913e-ea82aa149695 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "DELETE /v2.0/floatingips/6c4f2780-5e73-457f-b7c3-3364e830961c HTTP/1.1" status: 204  len: 168 time: 2.5884514
Jun 01 12:44:35.045998 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:35.048423 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4c066a6-f588-4523-bde5-52483efd5f59" -d '{"events": [{"name": "network-changed", "server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:35.077220 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:35.158907 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e23c8453-8eeb-4121-ac73-25386870a170 req-303e5d30-4ce4-4586-997d-e84797f180cc tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1507785
Jun 01 12:44:35.221603 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c2476b79-f044-4088-8992-169d45abdf25 req-6be1e556-66f7-4b3e-bf34-0856d712d127 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1690943
Jun 01 12:44:35.252730 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-678ec72e-61ce-419e-b863-ec4addbecca2 x-openstack-request-id: req-678ec72e-61ce-419e-b863-ec4addbecca2 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:35.253198 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:35.253587 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-678ec72e-61ce-419e-b863-ec4addbecca2 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:35.254137 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'status': 'completed', 'code': 200}
Jun 01 12:44:35.433645 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c2476b79-f044-4088-8992-169d45abdf25 req-51d68c54-5e06-4ddb-b5f1-891144499ab7 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2034187
Jun 01 12:44:35.479244 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-08cb104e-5782-4199-9d22-718e2f4a6268 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:35.481272 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-08cb104e-5782-4199-9d22-718e2f4a6268 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 1098 time: 0.2184439
Jun 01 12:44:35.527106 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 1fa74d48-8b7c-46a0-912d-7e4406c1a30d details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:44:35.547690 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac73452f-53ae-4457-8400-f21e98689f59 req-919aa361-c34e-4019-a23c-e8dc8c117fbc tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:35.548694 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ac73452f-53ae-4457-8400-f21e98689f59 req-919aa361-c34e-4019-a23c-e8dc8c117fbc tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:35.570148 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ac73452f-53ae-4457-8400-f21e98689f59 req-919aa361-c34e-4019-a23c-e8dc8c117fbc tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:35.573039 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ac73452f-53ae-4457-8400-f21e98689f59 req-919aa361-c34e-4019-a23c-e8dc8c117fbc tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 945 time: 0.1273711
Jun 01 12:44:35.637848 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ac73452f-53ae-4457-8400-f21e98689f59 req-aad44db6-6af7-493e-b8b4-e04cf11a9097 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0563469
Jun 01 12:44:35.645569 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-8cfcf5c5-25cc-43a8-82b4-e7d369583735 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:35.646808 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25084a30>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:33Z', 'revision_number': 1, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:35.647073 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-8cfcf5c5-25cc-43a8-82b4-e7d369583735 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1590667
Jun 01 12:44:35.662364 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:44:35.691324 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:35.691875 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25084a30>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:13Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:35.725509 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-c6ca6a4e-46cc-4088-bf76-aa1783f7946a service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=f134ab33-87e8-442b-8165-d6bba1a217db HTTP/1.1" status: 200  len: 217 time: 0.0693645
Jun 01 12:44:35.756588 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:35.800704 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-79962661-6aff-49bc-9ebc-efd1ba028dd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:35.802485 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'port_id': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', 'mac_address': 'fa:16:3e:a7:51:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 787, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'efb47d96-d48f-48ad-9699-a0a2eb0a84b2', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:44:35.802709 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-79962661-6aff-49bc-9ebc-efd1ba028dd4 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.0699728
Jun 01 12:44:35.909149 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-e7953bff-76ff-437c-8672-4e6c367906e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:35.910799 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-e7953bff-76ff-437c-8672-4e6c367906e1 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1013172
Jun 01 12:44:35.991158 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:36.023402 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:36.074773 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1fa74d48-8b7c-46a0-912d-7e4406c1a30d {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:44:36.103229 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-7a2b46ea-8592-4e3b-8a94-04c3615913dc service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1833837
Jun 01 12:44:36.120846 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:36.193146 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:36.194383 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-488b432e-7a20-4120-a7f7-bf046df230fe None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:36.281616 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d4c066a6-f588-4523-bde5-52483efd5f59 req-9e3d3e6a-ab18-49d0-80cc-271439c485fb service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1705127
Jun 01 12:44:36.342473 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:36.351858 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:36.427400 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c0ad20-e4af-415e-917e-a8030e1ecc4b req-485342cd-d3dd-4251-9507-e4288dfd1925 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:36.429086 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-72c0ad20-e4af-415e-917e-a8030e1ecc4b req-485342cd-d3dd-4251-9507-e4288dfd1925 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 944 time: 0.1227250
Jun 01 12:44:36.456483 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['1fa74d48-8b7c-46a0-912d-7e4406c1a30d'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:44:36.476600 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-72c0ad20-e4af-415e-917e-a8030e1ecc4b req-c77a9398-440a-4c0b-9f6f-e957df25b8d6 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398428
Jun 01 12:44:36.655674 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25084a30>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:33Z', 'revision_number': 1, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:36.670112 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa1aaa3b-d296-4dad-aa87-7d2d8b69ec27 None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_floatingips': [{'id': '8857f6b8-23b3-44b5-a664-658660ca4acf', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'floating_ip_address': '172.27.3.126', 'floating_network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'router_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'port_id': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 569, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'mac_address': 'fa:16:3e:cd:60:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-06-01T12:40:28Z', 'updated_at': '2021-06-01T12:40:33Z', 'revision_number': 1, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:44:36.843959 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e467e743-761c-4605-a4a7-247759e927a3 req-b54eb901-6616-4945-b3c3-87dcc4ed113e tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:36.845489 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e467e743-761c-4605-a4a7-247759e927a3 req-b54eb901-6616-4945-b3c3-87dcc4ed113e tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 945 time: 0.0848053
Jun 01 12:44:36.890171 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3d2f0fc-f3ca-4c3c-b755-7010aaa863bd None None] New status for floating IP 6c4f2780-5e73-457f-b7c3-3364e830961c: DOWN {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:44:36.892483 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-e467e743-761c-4605-a4a7-247759e927a3 req-8afc21de-737b-4216-b6d6-60f9ac973a3e tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0413156
Jun 01 12:44:37.011528 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-c8c7d745-5e8a-4750-8efc-0753ec40a5fe tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:37.012891 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-c8c7d745-5e8a-4750-8efc-0753ec40a5fe tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 945 time: 0.0788822
Jun 01 12:44:37.153966 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Deleting port f134ab33-87e8-442b-8165-d6bba1a217db {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:37.154307 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:37.302380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] For port f134ab33-87e8-442b-8165-d6bba1a217db, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=f134ab33-87e8-442b-8165-d6bba1a217db,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:37.302727 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:37.429177 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Calling delete_port for f134ab33-87e8-442b-8165-d6bba1a217db owned by compute:nova {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:37.545672 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 1fa74d48-8b7c-46a0-912d-7e4406c1a30d up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:44:37.546282 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:37.552925 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-094e649b-6f9a-4d23-b236-fb48c36d5706 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:37.648648 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event deleted for resources: {'Port': ['ID=f134ab33-87e8-442b-8165-d6bba1a217db,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:37.686118 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:44:37.691051 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:44:37.691432 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:37.704304 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.704864 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.705380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.705888 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.706388 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.706889 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.707391 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.707886 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.708379 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.708911 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.709403 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.709903 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:37.723228 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:37.764424 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] No DVR routers for this DVR port f134ab33-87e8-442b-8165-d6bba1a217db on host hv-cinder-79351 {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:44:37.767086 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:37.769754 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'name': 'network-vif-deleted', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db'}] {{(pid=91978) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:37.771976 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}08332f069cdff5b13479b061d6bbe376049db186f7bff4c04e61a4b86035db55" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-591d2772-8238-476b-a367-4f72687c799d" -d '{"events": [{"server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "name": "network-vif-deleted", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db"}]}' {{(pid=91978) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:37.799467 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cba86001-4664-4ae4-ae3f-3dcb847dff3e req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "DELETE /v2.0/ports/f134ab33-87e8-442b-8165-d6bba1a217db HTTP/1.1" status: 204  len: 173 time: 0.7783740
Jun 01 12:44:37.814134 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cbb2fee-be4e-489f-8f09-c2cdec13e3d9 req-380fb354-f680-4ce3-9331-2500f024b049 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:37.815907 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6cbb2fee-be4e-489f-8f09-c2cdec13e3d9 req-380fb354-f680-4ce3-9331-2500f024b049 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 944 time: 0.2210665
Jun 01 12:44:37.820131 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:37.831438 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-219643ad-f07d-44dc-a487-c358796ada95 x-openstack-request-id: req-219643ad-f07d-44dc-a487-c358796ada95 {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:37.831778 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75be3d0d-2e49-446b-a8d1-ca2883a311f4", "name": "network-vif-deleted", "tag": "f134ab33-87e8-442b-8165-d6bba1a217db", "status": "completed", "code": 200}]} {{(pid=91978) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:37.832551 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-219643ad-f07d-44dc-a487-c358796ada95 {{(pid=91978) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:37.832551 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75be3d0d-2e49-446b-a8d1-ca2883a311f4', 'name': 'network-vif-deleted', 'tag': 'f134ab33-87e8-442b-8165-d6bba1a217db', 'status': 'completed', 'code': 200}
Jun 01 12:44:37.853796 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:37.857326 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-081f85fe-9337-4612-a825-3a4597093b29" -d '{"events": [{"server_uuid": "d4b4b549-909c-441d-96cc-af20fa66dd25", "name": "network-vif-plugged", "status": "completed", "tag": "1fa74d48-8b7c-46a0-912d-7e4406c1a30d"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:37.878526 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:37.886519 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:37.887862 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device f134ab33-87e8-442b-8165-d6bba1a217db no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:37.919595 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d82ed35-0a5b-4c5d-b716-b4c444370b61 x-openstack-request-id: req-9d82ed35-0a5b-4c5d-b716-b4c444370b61 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:37.919925 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d4b4b549-909c-441d-96cc-af20fa66dd25", "name": "network-vif-plugged", "status": "completed", "tag": "1fa74d48-8b7c-46a0-912d-7e4406c1a30d", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:37.920254 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-9d82ed35-0a5b-4c5d-b716-b4c444370b61 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:37.920732 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', 'code': 200}
Jun 01 12:44:37.925987 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:37.992108 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: f134ab33-87e8-442b-8165-d6bba1a217db {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:37.992981 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device f134ab33-87e8-442b-8165-d6bba1a217db not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:38.032758 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-6cbb2fee-be4e-489f-8f09-c2cdec13e3d9 req-93f397fd-a204-4645-909b-094c53dee0fe tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1985347
Jun 01 12:44:38.045015 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:38.054503 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:38.113713 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-cb670548-7195-434c-b17e-fa9f4c89a586 req-c6f19625-f36b-4672-9c8d-d473f276549f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=75be3d0d-2e49-446b-a8d1-ca2883a311f4 HTTP/1.1" status: 200  len: 210 time: 0.0530765
Jun 01 12:44:38.222576 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-923cbdb5-195e-4ad6-89ea-eca961519df7 req-76f9225a-e844-47c3-b2dd-c2bcb247fe5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:38.223941 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-923cbdb5-195e-4ad6-89ea-eca961519df7 req-76f9225a-e844-47c3-b2dd-c2bcb247fe5e service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 1098 time: 0.0743158
Jun 01 12:44:38.271017 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-923cbdb5-195e-4ad6-89ea-eca961519df7 req-fae67360-85de-4c9d-b75b-83584aeab3a3 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387211
Jun 01 12:44:39.236009 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb8856b-5e9f-4198-ae4e-99657234c9f4 req-81379603-2cae-45bb-b3ca-7b6c4721b8e6 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:39.237564 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cfb8856b-5e9f-4198-ae4e-99657234c9f4 req-81379603-2cae-45bb-b3ca-7b6c4721b8e6 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 945 time: 0.0923719
Jun 01 12:44:39.287513 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-cfb8856b-5e9f-4198-ae4e-99657234c9f4 req-30cad6f9-747e-44d4-8847-49cc9f72e89e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0438378
Jun 01 12:44:39.842399 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-45c125c6-5cd2-4f3d-991c-0184acf17cee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:40.487294 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ceb123-ec37-41e4-bb83-9ca276faec02 req-04ce233e-1e74-40ba-97ec-96d774124644 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:40.488803 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-43ceb123-ec37-41e4-bb83-9ca276faec02 req-04ce233e-1e74-40ba-97ec-96d774124644 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 945 time: 0.0833402
Jun 01 12:44:40.535117 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-43ceb123-ec37-41e4-bb83-9ca276faec02 req-75f416bf-9782-4331-a231-5b5adb0a9270 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405381
Jun 01 12:44:41.653889 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36674) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:41.930529 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Deleting port e013d702-bc77-4b8c-b5c7-364ef17b4e1b {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:41.930817 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.057158 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.057972 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.174429 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.183622 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Calling delete_port for e013d702-bc77-4b8c-b5c7-364ef17b4e1b owned by network:floatingip {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:42.320662 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.324447 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9ea231d2-de6c-4b61-80f1-7c356b8ba33c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:42.332603 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.369792 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event deleted for resources: {'Port': ['ID=e013d702-bc77-4b8c-b5c7-364ef17b4e1b,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:42.396438 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:42.586162 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.586766 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.db.l3_db [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Floating IP 8857f6b8-23b3-44b5-a664-658660ca4acf disassociated (deleted). External IP: 172.27.3.126, port: 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887.
Jun 01 12:44:42.687096 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ee835168-360d-4c92-9242-c166a06aa4a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:42.796644 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5128233e-b9ec-44f6-918a-16209649afb1 req-744bb806-6c08-4c60-b04e-21473ed58b7e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:42.798557 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-744bb806-6c08-4c60-b04e-21473ed58b7e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.1615064
Jun 01 12:44:42.820607 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-abc7d0dc-a554-47d6-a18e-4bcb9f90d97b tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/quotas/b6d1ef7d540a43c6869c7fa1a0838204 HTTP/1.1" status: 200  len: 375 time: 0.0144594
Jun 01 12:44:42.921847 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-0f48e60f-5664-457e-9f2d-93eafe73687c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0934930
Jun 01 12:44:42.933403 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-72ccbec7-9dfa-4549-b5d0-00676ddc0c68 service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=91978) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
Jun 01 12:44:42.934541 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-72ccbec7-9dfa-4549-b5d0-00676ddc0c68 service neutron] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0061800
Jun 01 12:44:42.951977 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91979) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:44:43.082830 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-60035f95-3d4c-47e1-a39d-8039b081861a service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1414549
Jun 01 12:44:43.138852 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91979) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:44:43.149248 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:44:43.157986 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:43.159688 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:43.160401 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a24e4fa30>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:43.213529 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-516d2e58-05b8-4d32-82b8-2fbad30b1a9f tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "DELETE /v2.0/floatingips/8857f6b8-23b3-44b5-a664-658660ca4acf HTTP/1.1" status: 204  len: 168 time: 1.5585401
Jun 01 12:44:43.215405 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:43.218211 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49b22faa-ba94-4030-a743-f046a7c1716f" -d '{"events": [{"name": "network-changed", "server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:43.229072 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-319c6538-3010-4080-9777-8e35540142e1 service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1401150
Jun 01 12:44:43.354623 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:43.373192 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-157daa6b-1a3c-4cb5-b10a-5716e59dc6da x-openstack-request-id: req-157daa6b-1a3c-4cb5-b10a-5716e59dc6da {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:43.373569 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:43.373851 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-157daa6b-1a3c-4cb5-b10a-5716e59dc6da {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:43.374892 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'status': 'completed', 'code': 200}
Jun 01 12:44:43.533113 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-006cf802-35f0-47b2-91bf-1b5312e6e8ad req-7e47854a-8740-491e-93ef-505bcbba6b87 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 210 time: 0.0800114
Jun 01 12:44:43.572107 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b22faa-ba94-4030-a743-f046a7c1716f req-91b052f5-0902-47a1-a7f5-92367a420db0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:43.574013 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-49b22faa-ba94-4030-a743-f046a7c1716f req-91b052f5-0902-47a1-a7f5-92367a420db0 service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=892af7572bdb454483d1279dcfc9ccb0&device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 1099 time: 0.1733561
Jun 01 12:44:43.735257 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a24e4fa30>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:43.739726 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:44:43.742988 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d7db70-5620-422c-8f44-afdfbca4d5ff req-4eef272b-1fe4-49a8-ba0d-2ad2b974481d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:43.744007 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-57d7db70-5620-422c-8f44-afdfbca4d5ff req-4eef272b-1fe4-49a8-ba0d-2ad2b974481d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:43.749538 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:43.750099 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a24e4fa30>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:43.755715 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b22faa-ba94-4030-a743-f046a7c1716f req-8164819a-f78f-42fb-a313-ec3b880f8d51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:43.757558 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-49b22faa-ba94-4030-a743-f046a7c1716f req-8164819a-f78f-42fb-a313-ec3b880f8d51 service neutron] 10.222.0.95 "GET /v2.0/networks?id=42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 200  len: 913 time: 0.1734326
Jun 01 12:44:43.774832 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-57d7db70-5620-422c-8f44-afdfbca4d5ff req-4eef272b-1fe4-49a8-ba0d-2ad2b974481d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:43.776840 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57d7db70-5620-422c-8f44-afdfbca4d5ff req-4eef272b-1fe4-49a8-ba0d-2ad2b974481d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.1767545
Jun 01 12:44:43.838851 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-57d7db70-5620-422c-8f44-afdfbca4d5ff req-bf30bc97-6bca-40d4-b14f-72691d7e2d73 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0531969
Jun 01 12:44:43.844861 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-49b22faa-ba94-4030-a743-f046a7c1716f req-ad165edb-76c5-4eb9-a95d-305c7e0592ea service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 HTTP/1.1" status: 200  len: 217 time: 0.0784471
Jun 01 12:44:43.964067 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:43.983084 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b22faa-ba94-4030-a743-f046a7c1716f req-3beb9cb8-d507-48fc-9f4b-11b7d187734f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:43.985078 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-49b22faa-ba94-4030-a743-f046a7c1716f req-3beb9cb8-d507-48fc-9f4b-11b7d187734f service neutron] 10.222.0.95 "GET /v2.0/subnets?id=056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 200  len: 851 time: 0.1305647
Jun 01 12:44:44.021769 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:44.079526 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b22faa-ba94-4030-a743-f046a7c1716f req-122bbdc5-197f-4ab8-b491-2cae3259241c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:44.080704 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-49b22faa-ba94-4030-a743-f046a7c1716f req-122bbdc5-197f-4ab8-b491-2cae3259241c service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=42f63911-56d5-4572-8431-a99e560ca482&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0880346
Jun 01 12:44:44.252996 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-49b22faa-ba94-4030-a743-f046a7c1716f req-d71cffc9-1da7-4abc-88ba-f02bf880c997 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1643064
Jun 01 12:44:44.357000 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-20bb4306-c9b7-4c96-88ca-7b6757f85c70 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0863476
Jun 01 12:44:44.407271 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a24e4fa30>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:44.412834 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9169ca48-b783-40c9-9b01-96553cb7d072 None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:36:43Z', 'revision_number': 4, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi', '_interfaces': [{'id': '0feddf7d-6197-457c-9357-35720610c9f9', 'name': '', 'network_id': '42f63911-56d5-4572-8431-a99e560ca482', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'mac_address': 'fa:16:3e:a4:80:1d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_interface', 'standard_attr_id': 385, 'fixed_ips': [{'subnet_id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:42Z', 'updated_at': '2021-06-01T12:36:52Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'subnets': [{'id': '056def2a-a8b2-4665-b4ba-cc9e031e8b58', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:44:44.442916 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-49b22faa-ba94-4030-a743-f046a7c1716f req-97c4ffb7-5e40-43eb-92e2-7b3a6e26d0e6 service neutron] 10.222.0.95 "GET /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1703894
Jun 01 12:44:44.553618 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-60324851-cd84-4ebb-ba04-df5145db58cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:44.555259 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-60324851-cd84-4ebb-ba04-df5145db58cc service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 1098 time: 0.0761564
Jun 01 12:44:44.681676 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06810d7d-8d54-423d-b261-d52a589863f0 None None] New status for floating IP 8857f6b8-23b3-44b5-a664-658660ca4acf: DOWN {{(pid=91981) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
Jun 01 12:44:44.831826 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-e451990a-7954-481b-8c05-6a1249e6af97 req-3863916a-c247-44ac-83a8-18e7a6faf0bc tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 210 time: 0.0672655
Jun 01 12:44:44.905566 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-b6bb9063-c6c1-4c39-b539-9e9a04af116f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:44.907579 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-b6bb9063-c6c1-4c39-b539-9e9a04af116f service neutron] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 915 time: 0.3277364
Jun 01 12:44:44.998937 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-8c75a581-e66c-49a5-86e0-1812113fb708 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df HTTP/1.1" status: 200  len: 217 time: 0.0761306
Jun 01 12:44:45.082288 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 36744) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:45.084296 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-501daf07-2c6b-4684-95c0-e09d0bacef89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:45.086271 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-501daf07-2c6b-4684-95c0-e09d0bacef89 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.0795326
Jun 01 12:44:45.135602 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-fc01bacb-1fa6-40a9-8584-1566353467f8 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0421994
Jun 01 12:44:45.164637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5128233e-b9ec-44f6-918a-16209649afb1 req-aa882ec5-2474-4dab-b952-b10e884c937a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:45.165981 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-aa882ec5-2474-4dab-b952-b10e884c937a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.2866724
Jun 01 12:44:45.181731 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Request body: {'port': {'device_id': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'admin_state_up': True, 'tenant_id': 'b6d1ef7d540a43c6869c7fa1a0838204'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:45.203384 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_v2 [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Deleting subnet c3173bfc-9767-47db-882f-01b7eae76aff {{(pid=91979) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:44:45.221239 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f84a2c-2e59-4004-954c-1dca92e39f7a req-3d7128f1-269c-4af5-baa7-3a1ef635b820 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:45.222703 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37f84a2c-2e59-4004-954c-1dca92e39f7a req-3d7128f1-269c-4af5-baa7-3a1ef635b820 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.2461228
Jun 01 12:44:45.226026 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:45.292736 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-7b518842-7809-4427-a141-55c99c25149a service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1389322
Jun 01 12:44:45.432451 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-287e50e5-2f11-4168-8d6b-30e613d8f33c req-8f352d96-7028-4a23-adff-b43b9932c54d service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1339545
Jun 01 12:44:45.442374 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:45.462686 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-37f84a2c-2e59-4004-954c-1dca92e39f7a req-60e3fa94-bea6-40f0-85e2-ed072056cd3d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1688614
Jun 01 12:44:45.469763 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2204557'] for subnet, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:45.626031 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:44:45.645058 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:44:45.669830 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:45.697038 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Made reservation on behalf of b6d1ef7d540a43c6869c7fa1a0838204 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:44:45.701291 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:45.731190 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-65b84ea8-a7c2-41c2-9139-f6359bd78751 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:45.732768 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-65b84ea8-a7c2-41c2-9139-f6359bd78751 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.4405036
Jun 01 12:44:46.002792 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-29c149ab-c78d-4176-b747-ef6d52306576 req-20c01dac-c1d9-4d3c-91f0-1955669d702d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 210 time: 0.0489333
Jun 01 12:44:46.148679 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Allocated IP 172.20.0.10 (4c119a34-b195-4741-b131-afc7d89e3c41/efb47d96-d48f-48ad-9699-a0a2eb0a84b2/5ae5a07b-8e75-4d93-b058-8222e2a023d5) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:44:46.206325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Deleting port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:46.206733 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:46.410034 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2610798', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2345669'] for subnet, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:46.486757 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-bb78c0d2-bab5-4c07-bc40-9f60e4ffdbd8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:46.525237 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] For port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:46.525595 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:46.550921 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c3173bfc-9767-47db-882f-01b7eae76aff,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:46.553532 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:46.686790 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Calling delete_port for 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:46.728645 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.729022 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.729952 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.730308 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.730662 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.731016 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.731365 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.731712 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.732061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.732408 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.732778 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.733147 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:46.751062 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:46.788004 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-a7d54eb8-bcd5-4670-aedf-7261659b0a9c admin admin] 10.222.0.81 "DELETE /v2.0/subnets/c3173bfc-9767-47db-882f-01b7eae76aff HTTP/1.1" status: 204  len: 168 time: 1.7045238
Jun 01 12:44:46.790756 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36756) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:46.829545 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:46.897492 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-718fd4ec-6da6-4211-ae14-3097bcd441e6 req-499b862e-5f35-4160-84ab-8fd9648e04df tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:46.897817 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-718fd4ec-6da6-4211-ae14-3097bcd441e6 req-499b862e-5f35-4160-84ab-8fd9648e04df tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 946 time: 0.2886713
Jun 01 12:44:46.910748 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:46.971490 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:46.983285 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df', '1fa74d48-8b7c-46a0-912d-7e4406c1a30d'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:44:46.989335 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-36dc15c2-aa06-41c2-9224-8fd6e154564e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:47.074494 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.080235 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-718fd4ec-6da6-4211-ae14-3097bcd441e6 req-d43aec7e-3045-483f-8880-a6db7e944c40 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/security-groups?id=886adde4-fecb-48e7-a65d-8c4b1eef5d0e&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1727431
Jun 01 12:44:47.091110 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Network 4c119a34-b195-4741-b131-afc7d89e3c41 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:44:47.094285 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a1fdbe070>,) {'filters': {'network_id': ['1308baa5-7150-4a84-ac5f-c2c161212d06']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:47.097772 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:44:47.106131 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.110133 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a1fdbe070>, '0639fdd3-7524-43ac-8e87-bab2babae079') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:47.110734 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a1fdbe070>, '0639fdd3-7524-43ac-8e87-bab2babae079') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:47.142046 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:44:47.147310 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.174167 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event updated for resources: {'Port': ['ID=5ae5a07b-8e75-4d93-b058-8222e2a023d5,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:47.177325 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:47.185542 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-21329895-5807-436a-8c6f-fa2c51758df0 tempest-VolumesSnapshotTestJSON-602908537 tempest-VolumesSnapshotTestJSON-602908537-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.017s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:47.206917 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.216532 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Releasing vlan 754 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:44:47.217059 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:44:47.235003 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:44:47.286230 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event deleted for resources: {'Port': ['ID=74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:47.288685 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:47.331829 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] No DVR routers for this DVR port 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:44:47.335722 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.341533 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'name': 'network-vif-deleted', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:47.344932 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a82002f6-68fc-48f8-83a9-461248d9c40b" -d '{"events": [{"server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "name": "network-vif-deleted", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:47.346569 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.352761 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f6654be5-0d06-4560-9a7c-03ee49ae3b52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:47.359417 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:47.360257 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.370596 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.387011 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-d6a414e5-7760-4917-9942-fa4e66fc38fe req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.95 "DELETE /v2.0/ports/74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 HTTP/1.1" status: 204  len: 173 time: 1.6482787
Jun 01 12:44:47.387851 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b08809e-813f-43d2-b5e7-b3660ecb5494 req-bd419ba3-c035-4226-98c6-69bee67fb534 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:47.390961 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-8ecf468a-fac9-4d42-8f2e-563928d29404 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.2144172
Jun 01 12:44:47.392663 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8b08809e-813f-43d2-b5e7-b3660ecb5494 req-bd419ba3-c035-4226-98c6-69bee67fb534 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 932 time: 0.2345145
Jun 01 12:44:47.398851 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Pushing event deleted for resources: {'Network': ['ID=1308baa5-7150-4a84-ac5f-c2c161212d06,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:47.405411 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:47.425411 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Request body: {'port': {'device_id': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:44:47.457352 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-5428c170-41e4-486a-bd04-eaa0e61fac1d admin admin] 10.222.0.81 "DELETE /v2.0/networks/1308baa5-7150-4a84-ac5f-c2c161212d06 HTTP/1.1" status: 204  len: 168 time: 0.6651876
Jun 01 12:44:47.466265 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e0b7083-1941-4b65-9bbd-f0ca0f505e61 x-openstack-request-id: req-8e0b7083-1941-4b65-9bbd-f0ca0f505e61 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:47.466599 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31dbac8d-2741-4672-b93c-9839ffcbac91", "name": "network-vif-deleted", "tag": "74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:47.466884 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-8e0b7083-1941-4b65-9bbd-f0ca0f505e61 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:47.467306 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31dbac8d-2741-4672-b93c-9839ffcbac91', 'name': 'network-vif-deleted', 'tag': '74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887', 'status': 'completed', 'code': 200}
Jun 01 12:44:47.497181 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-8b08809e-813f-43d2-b5e7-b3660ecb5494 req-60e13130-3cde-496d-a005-26013aae8001 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0787284
Jun 01 12:44:47.628957 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36766) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:47.685420 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d5696c49-ff36-4c75-82fc-1a155c789749 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5a84a76793e14c6f80e91f0ce9a6e26e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0549757
Jun 01 12:44:47.686921 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36770) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:47.699102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.765749 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-22e659e4-f224-445a-b283-1eee4ca63146 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.796038 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-22e659e4-f224-445a-b283-1eee4ca63146 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.875759 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-22e659e4-f224-445a-b283-1eee4ca63146 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.880202 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-ecc90fb5-7395-4864-968c-e806a08c6062 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:47.892937 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e659e4-f224-445a-b283-1eee4ca63146 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35e4bc64-bf49-4bbe-9a5e-a26d22bc435e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:47.898732 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-22e659e4-f224-445a-b283-1eee4ca63146 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:47.915933 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-22e659e4-f224-445a-b283-1eee4ca63146 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:47.917483 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-22e659e4-f224-445a-b283-1eee4ca63146 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/35e4bc64-bf49-4bbe-9a5e-a26d22bc435e HTTP/1.1" status: 204  len: 168 time: 0.2295287
Jun 01 12:44:48.089727 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5ae5a07b-8e75-4d93-b058-8222e2a023d5 {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:44:48.098463 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:48.115703 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Transition to ACTIVE for port object 5ae5a07b-8e75-4d93-b058-8222e2a023d5 will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:44:48.122149 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:48.126935 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-20dc116a-ef46-4ab2-a886-13eb94b87faf tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:48.284973 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Pushing event updated for resources: {'Port': ['ID=5ae5a07b-8e75-4d93-b058-8222e2a023d5,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:48.318804 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:48.390708 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-6b88dcb4-860d-4312-bf84-04a344f0e7c7 req-9ef33260-36eb-4ade-b0d6-6f612bf89489 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Synchronizing usage tracker for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:48.461149 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-6b88dcb4-860d-4312-bf84-04a344f0e7c7 req-9ef33260-36eb-4ade-b0d6-6f612bf89489 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Unset dirty status for tenant:892af7572bdb454483d1279dcfc9ccb0 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:48.462478 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6b88dcb4-860d-4312-bf84-04a344f0e7c7 req-9ef33260-36eb-4ade-b0d6-6f612bf89489 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "GET /v2.0/ports?device_id=31dbac8d-2741-4672-b93c-9839ffcbac91 HTTP/1.1" status: 200  len: 210 time: 0.1423023
Jun 01 12:44:48.483380 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Attempting to bind port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:44:48.483716 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Attempting to bind port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:44:48.484045 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Attempting to bind port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:44:48.488964 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 on network 4c119a34-b195-4741-b131-afc7d89e3c41 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:44:48.489332 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Attempting to bind port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:44:48.494760 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 44, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:44:48.495102 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Checking segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:44:48.495485 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Bound using segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:44:48.495907 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Bound port: 5ae5a07b-8e75-4d93-b058-8222e2a023d5, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:44:48.496255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:48.589049 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] For port 5ae5a07b-8e75-4d93-b058-8222e2a023d5, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:44:48.592038 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] For port 5ae5a07b-8e75-4d93-b058-8222e2a023d5, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=5ae5a07b-8e75-4d93-b058-8222e2a023d5,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:44:48.597998 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:48.602692 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-de438e2c-b5fa-4889-a09d-9bfe6f646c1b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:48.671388 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:48.671994 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:48.673374 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] 10.222.0.95 "PUT /v2.0/ports/5ae5a07b-8e75-4d93-b058-8222e2a023d5 HTTP/1.1" status: 200  len: 1094 time: 1.2646611
Jun 01 12:44:48.704796 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Pushing event updated for resources: {'Port': ['ID=5ae5a07b-8e75-4d93-b058-8222e2a023d5,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:48.711115 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:48.721501 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b74281-2366-416b-affd-516657a7f447 req-352fb253-b0d2-433c-ab3b-a93b18c681cd tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:48.723040 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a7b74281-2366-416b-affd-516657a7f447 req-352fb253-b0d2-433c-ab3b-a93b18c681cd tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 944 time: 0.1078644
Jun 01 12:44:48.771090 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-a7b74281-2366-416b-affd-516657a7f447 req-f3553140-8ea2-47a2-8bf5-f0416742a71f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413060
Jun 01 12:44:48.794188 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5128233e-b9ec-44f6-918a-16209649afb1 req-4f1c5d40-231a-4dc9-a866-6156ed05562f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:48.795646 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-4f1c5d40-231a-4dc9-a866-6156ed05562f service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 1097 time: 0.0746038
Jun 01 12:44:48.874573 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-ed6687db-583b-468a-9c4c-d8372caaecc5 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5ae5a07b-8e75-4d93-b058-8222e2a023d5 HTTP/1.1" status: 200  len: 217 time: 0.0698617
Jun 01 12:44:48.942074 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5128233e-b9ec-44f6-918a-16209649afb1 req-9800f441-5ac5-4174-803d-42e74aad59a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:48.943600 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-9800f441-5ac5-4174-803d-42e74aad59a5 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.0621221
Jun 01 12:44:48.994568 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-4edf906e-4566-43a8-b06c-3e8849df8473 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0443141
Jun 01 12:44:49.133872 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-f5c53841-30aa-4701-8a6d-5edfc17a72bb service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1270657
Jun 01 12:44:49.267038 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5128233e-b9ec-44f6-918a-16209649afb1 req-1a882580-80eb-480f-8f08-bc1c986e57d0 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1265919
Jun 01 12:44:49.468191 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'tag': '5ae5a07b-8e75-4d93-b058-8222e2a023d5'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:49.470611 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20f576da-0cc8-490e-a7fe-42d6ecfd1058" -d '{"events": [{"name": "network-changed", "server_uuid": "dba31791-66d0-4043-8eec-6ba7f782020a", "tag": "5ae5a07b-8e75-4d93-b058-8222e2a023d5"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:49.513453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-245d3555-43cd-4294-83c5-59f37b5a781c x-openstack-request-id: req-245d3555-43cd-4294-83c5-59f37b5a781c {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:49.513790 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dba31791-66d0-4043-8eec-6ba7f782020a", "tag": "5ae5a07b-8e75-4d93-b058-8222e2a023d5", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:49.514079 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-245d3555-43cd-4294-83c5-59f37b5a781c {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:49.514539 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'tag': '5ae5a07b-8e75-4d93-b058-8222e2a023d5', 'status': 'completed', 'code': 200}
Jun 01 12:44:49.561285 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36784) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:49.598357 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:49.632978 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:49.633216 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-38b994bc-f325-426c-826f-d4588f9133db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:49.633485 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 74e0c4aa-5f54-4e67-a6b7-d08fbbcf3887 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:49.634619 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-38b994bc-f325-426c-826f-d4588f9133db service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 1097 time: 0.0867584
Jun 01 12:44:49.878988 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-3e368539-f705-40e6-a2fa-021d54f3c2b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:49.880753 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-3e368539-f705-40e6-a2fa-021d54f3c2b8 service neutron] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 915 time: 0.2395790
Jun 01 12:44:49.907914 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Deleting port 9d555299-8581-40e5-b057-06221c7a592c {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:49.908498 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:49.991996 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-ddbb4e76-316a-4aee-b37b-1fa6a1d52a72 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5ae5a07b-8e75-4d93-b058-8222e2a023d5 HTTP/1.1" status: 200  len: 217 time: 0.1041389
Jun 01 12:44:50.031653 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:50.032112 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:50.082757 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-a1d01583-2c4b-495e-8319-42222b2dd92f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:50.084306 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-a1d01583-2c4b-495e-8319-42222b2dd92f service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.0770042
Jun 01 12:44:50.097157 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96aa0425-b8a0-4cdf-b104-b08fe1d9025a req-13b35bdb-2b32-464a-b821-48e0f7d3ed39 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:50.097853 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-96aa0425-b8a0-4cdf-b104-b08fe1d9025a req-13b35bdb-2b32-464a-b821-48e0f7d3ed39 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:44:50.144761 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-c31bf0bf-642c-414a-a121-080b80749582 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0440040
Jun 01 12:44:50.159512 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Calling delete_port for 9d555299-8581-40e5-b057-06221c7a592c owned by network:floatingip {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:50.232617 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-96aa0425-b8a0-4cdf-b104-b08fe1d9025a req-13b35bdb-2b32-464a-b821-48e0f7d3ed39 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:44:50.233761 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-96aa0425-b8a0-4cdf-b104-b08fe1d9025a req-13b35bdb-2b32-464a-b821-48e0f7d3ed39 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 944 time: 0.2916329
Jun 01 12:44:50.287052 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:50.291897 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2d4123bc-ad1f-4dcc-9f00-02aeb54e19bc tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:50.314167 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-96aa0425-b8a0-4cdf-b104-b08fe1d9025a req-caa4981c-1ab7-42fc-b184-0d79b9dfa1d3 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0727968
Jun 01 12:44:50.322723 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-4470cdb5-48f0-4647-a835-8ecebc156375 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1687055
Jun 01 12:44:50.365441 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event deleted for resources: {'Port': ['ID=9d555299-8581-40e5-b057-06221c7a592c,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:50.371836 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:50.431355 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for floatingip, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:50.451079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for floatingip, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:50.452307 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "DELETE /v2.0/floatingips/d2d1bbc3-bbff-4db5-abd1-679398f8f782 HTTP/1.1" status: 204  len: 168 time: 0.8898237
Jun 01 12:44:50.467609 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-20f576da-0cc8-490e-a7fe-42d6ecfd1058 req-947cc2e7-11cb-4fac-a86c-4b1acda47116 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1368353
Jun 01 12:44:51.509890 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fa9634-ecb9-4744-98c6-79616697757a req-0149eeba-72a6-4f22-98d9-ea719bec92a3 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:51.512008 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-64fa9634-ecb9-4744-98c6-79616697757a req-0149eeba-72a6-4f22-98d9-ea719bec92a3 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 944 time: 0.0845065
Jun 01 12:44:51.557780 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-64fa9634-ecb9-4744-98c6-79616697757a req-88065b7d-9f53-427a-acb1-ecb850228690 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392439
Jun 01 12:44:51.599149 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 5ae5a07b-8e75-4d93-b058-8222e2a023d5 details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:44:51.734776 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 5ae5a07b-8e75-4d93-b058-8222e2a023d5, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=5ae5a07b-8e75-4d93-b058-8222e2a023d5,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:51.749067 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': '5ae5a07b-8e75-4d93-b058-8222e2a023d5', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'port_id': '5ae5a07b-8e75-4d93-b058-8222e2a023d5', 'mac_address': 'fa:16:3e:d2:9f:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 787, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'efb47d96-d48f-48ad-9699-a0a2eb0a84b2', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:44:51.810567 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:51.828637 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5ae5a07b-8e75-4d93-b058-8222e2a023d5 {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:44:51.848149 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 5ae5a07b-8e75-4d93-b058-8222e2a023d5, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=5ae5a07b-8e75-4d93-b058-8222e2a023d5,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:51.855365 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:51.857965 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:51.872041 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36802) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:51.923465 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=5ae5a07b-8e75-4d93-b058-8222e2a023d5,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:51.930791 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.931140 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.931618 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.931956 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.932877 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.933326 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.933581 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.933950 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.934314 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.934664 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.934991 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.935367 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91980) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:44:51.939997 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:51.946379 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c596a0a1-5e2c-4e10-8cf7-8fb4d7fc9a47 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:51.977208 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c596a0a1-5e2c-4e10-8cf7-8fb4d7fc9a47 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:52.059162 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c596a0a1-5e2c-4e10-8cf7-8fb4d7fc9a47 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:52.063532 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2c563c53-b181-4ca9-81c6-556e8288f0ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:52.081181 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c596a0a1-5e2c-4e10-8cf7-8fb4d7fc9a47 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=886adde4-fecb-48e7-a65d-8c4b1eef5d0e,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:52.083941 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-c596a0a1-5e2c-4e10-8cf7-8fb4d7fc9a47 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:52.096429 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-c596a0a1-5e2c-4e10-8cf7-8fb4d7fc9a47 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:52.097675 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-c596a0a1-5e2c-4e10-8cf7-8fb4d7fc9a47 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] 10.222.0.81 "DELETE /v2.0/security-groups/886adde4-fecb-48e7-a65d-8c4b1eef5d0e HTTP/1.1" status: 204  len: 168 time: 0.2245865
Jun 01 12:44:52.123722 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['5ae5a07b-8e75-4d93-b058-8222e2a023d5'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:44:52.158753 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36808) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:52.905866 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc11b77a-d991-441d-97d1-c05952d27f7b req-9b7cd796-8b18-4256-a983-150c157686b5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:52.907480 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bc11b77a-d991-441d-97d1-c05952d27f7b req-9b7cd796-8b18-4256-a983-150c157686b5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 945 time: 0.2322681
Jun 01 12:44:53.136601 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-bc11b77a-d991-441d-97d1-c05952d27f7b req-730d34e6-07d1-4db6-8b75-dc93f41ced3a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2206016
Jun 01 12:44:53.258324 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:53.600943 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 5ae5a07b-8e75-4d93-b058-8222e2a023d5 up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:44:53.677569 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:44:53.683661 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:44:53.684034 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:53.691318 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Deleting port 0feddf7d-6197-457c-9357-35720610c9f9 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:53.691656 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:53.808461 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:53.832149 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] For port 0feddf7d-6197-457c-9357-35720610c9f9, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=0feddf7d-6197-457c-9357-35720610c9f9,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:53.832628 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:53.836957 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ae5a07b-8e75-4d93-b058-8222e2a023d5'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:44:53.839293 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c151629-48a4-4ea3-979f-081f76a10de8" -d '{"events": [{"server_uuid": "dba31791-66d0-4043-8eec-6ba7f782020a", "name": "network-vif-plugged", "status": "completed", "tag": "5ae5a07b-8e75-4d93-b058-8222e2a023d5"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:44:53.846995 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port 5ae5a07b-8e75-4d93-b058-8222e2a023d5, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=5ae5a07b-8e75-4d93-b058-8222e2a023d5,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:53.851707 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:53.853416 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:53.891976 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:44:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-535d50f7-f02e-4881-8be0-d06f51211369 x-openstack-request-id: req-535d50f7-f02e-4881-8be0-d06f51211369 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:44:53.892269 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dba31791-66d0-4043-8eec-6ba7f782020a", "name": "network-vif-plugged", "status": "completed", "tag": "5ae5a07b-8e75-4d93-b058-8222e2a023d5", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:44:53.892546 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-535d50f7-f02e-4881-8be0-d06f51211369 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:44:53.892937 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ae5a07b-8e75-4d93-b058-8222e2a023d5', 'code': 200}
Jun 01 12:44:53.932769 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=5ae5a07b-8e75-4d93-b058-8222e2a023d5,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:53.935722 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:53.971154 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Calling delete_port for 0feddf7d-6197-457c-9357-35720610c9f9 owned by network:router_interface {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:54.143626 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b90e98-a998-49ad-9eb8-bfdd7035b3bb req-7a18b19d-8fb9-4cf5-90eb-5447f7c9bc4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:54.144225 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:54.145259 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-12b90e98-a998-49ad-9eb8-bfdd7035b3bb req-7a18b19d-8fb9-4cf5-90eb-5447f7c9bc4f service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 1099 time: 0.0771623
Jun 01 12:44:54.149705 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7e5ce353-add1-4705-be8c-504da41a52eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:54.192823 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-12b90e98-a998-49ad-9eb8-bfdd7035b3bb req-7b79602a-4cdf-4769-8a25-7acc7bf2fa24 service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390661
Jun 01 12:44:54.195511 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=0feddf7d-6197-457c-9357-35720610c9f9,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:54.198165 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:54.523738 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d336aa2c-e664-4652-9db0-c700426901b4 req-782b2d99-6af3-462e-ad0b-ed08e9ce0b5b tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:54.525219 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d336aa2c-e664-4652-9db0-c700426901b4 req-782b2d99-6af3-462e-ad0b-ed08e9ce0b5b tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 946 time: 0.2509427
Jun 01 12:44:54.586661 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:54.595882 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d336aa2c-e664-4652-9db0-c700426901b4 req-32d9c949-110e-4813-82a3-866ec93d9484 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0600917
Jun 01 12:44:55.064548 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Router 1a362d20-82d6-490f-bb46-3dede6760253 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:44:55.245879 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:44:55.254982 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] Sync routers for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:44:55.258822 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b3a015b4-5549-47fb-a2af-d2be108d97c3 admin admin] 10.222.0.81 "PUT /v2.0/routers/1a362d20-82d6-490f-bb46-3dede6760253/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0989223
Jun 01 12:44:55.261326 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36820) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:55.264626 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:55.265326 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e932e0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:55.444143 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks [] for router, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:55.449476 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:55.624895 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:55.707073 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Deleting port 459514ae-5687-4f89-b04f-45365372c314 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:55.707403 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:55.756194 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e932e0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': '459514ae-5687-4f89-b04f-45365372c314', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:44:54Z', 'revision_number': 5, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port': {'id': '459514ae-5687-4f89-b04f-45365372c314', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:04:a8:cc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1a362d20-82d6-490f-bb46-3dede6760253', 'device_owner': 'network:router_gateway', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:38Z', 'updated_at': '2021-06-01T12:36:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:55.762249 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] Checking router: 1a362d20-82d6-490f-bb46-3dede6760253 for host: dv-cinder-793515-2-iscsi {{(pid=91980) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:44:55.771849 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] Routers {'1a362d20-82d6-490f-bb46-3dede6760253'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91980) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:44:55.772472 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25e932e0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['1a362d20-82d6-490f-bb46-3dede6760253'], 'active': True} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:55.808468 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adf0b4c-4a43-4e32-a6d7-564650619b73 req-895c981f-d603-4c08-ad1f-a72dacfc5852 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:44:55.810113 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9adf0b4c-4a43-4e32-a6d7-564650619b73 req-895c981f-d603-4c08-ad1f-a72dacfc5852 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 946 time: 0.0966105
Jun 01 12:44:55.867180 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-9adf0b4c-4a43-4e32-a6d7-564650619b73 req-9b425964-af9c-4fec-ba71-2fbbd9345316 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0501931
Jun 01 12:44:55.877241 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] For port 459514ae-5687-4f89-b04f-45365372c314, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=459514ae-5687-4f89-b04f-45365372c314,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:55.883765 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.024482 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvr_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] Set router 1a362d20-82d6-490f-bb46-3dede6760253 gateway port host: None {{(pid=91980) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:44:56.039897 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Calling delete_port for 459514ae-5687-4f89-b04f-45365372c314 owned by network:router_gateway {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:56.149957 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_hamode_db [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25e932e0>, [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:44:55Z', 'revision_number': 6, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port_host': None}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91980) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:56.156336 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f92c85c6-1bdd-4f22-9514-32e9ae440f5d None None] The sync data for ids ['1a362d20-82d6-490f-bb46-3dede6760253'] in dv-cinder-793515-2-iscsi is: [{'id': '1a362d20-82d6-490f-bb46-3dede6760253', 'name': 'tempest-TestVolumeBootPattern-1536690532-router', 'tenant_id': '892af7572bdb454483d1279dcfc9ccb0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:37Z', 'updated_at': '2021-06-01T12:44:55Z', 'revision_number': 6, 'project_id': '892af7572bdb454483d1279dcfc9ccb0', 'gw_port_host': None}] {{(pid=91980) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:44:56.332871 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.336907 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-33fd30be-bc49-46ef-97e7-1571778e3370 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:56.382565 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Pushing event deleted for resources: {'Port': ['ID=459514ae-5687-4f89-b04f-45365372c314,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:56.385842 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:56.488779 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.552469 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0feddf7d-6197-457c-9357-35720610c9f9 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:56.589743 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 0feddf7d-6197-457c-9357-35720610c9f9 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:56.590093 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 0feddf7d-6197-457c-9357-35720610c9f9 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:56.669712 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.671885 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.694793 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.695280 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1a362d20-82d6-490f-bb46-3dede6760253 {{(pid=91978) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:44:56.707576 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.708705 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-f662d43d-5f33-42f5-83e5-8571b9ea9156 admin admin] 10.222.0.81 "DELETE /v2.0/routers/1a362d20-82d6-490f-bb46-3dede6760253 HTTP/1.1" status: 204  len: 168 time: 1.4464424
Jun 01 12:44:56.711222 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36832) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:56.770619 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Deleting subnet 056def2a-a8b2-4665-b4ba-cc9e031e8b58 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:44:56.773553 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.826080 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:56.909954 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.180895 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.184776 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:57.219530 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Pushing event deleted for resources: {'Subnet': ['ID=056def2a-a8b2-4665-b4ba-cc9e031e8b58,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:57.224942 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:57.225928 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.231363 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab7376f7-e49c-4df4-830e-237726dfdf7b None None] Network 42f63911-56d5-4572-8431-a99e560ca482 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:44:57.234289 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-a78f0b96-8def-4118-a782-c5c5a9caccac admin admin] 10.222.0.81 "DELETE /v2.0/subnets/056def2a-a8b2-4665-b4ba-cc9e031e8b58 HTTP/1.1" status: 204  len: 168 time: 0.5215256
Jun 01 12:44:57.236238 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36836) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:57.348439 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.423842 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Deleting port 3346551a-7373-43a5-847b-45403c6dbdb6 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:57.424079 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.510003 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] DHCP port deletion for 42f63911-56d5-4572-8431-a99e560ca482 request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:44:57.540681 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] For port 3346551a-7373-43a5-847b-45403c6dbdb6, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=3346551a-7373-43a5-847b-45403c6dbdb6,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:57.541212 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.579113 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] Deleting port 3346551a-7373-43a5-847b-45403c6dbdb6 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:57.579775 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.671709 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Calling delete_port for 3346551a-7373-43a5-847b-45403c6dbdb6 owned by network:dhcp {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:57.687739 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] For port 3346551a-7373-43a5-847b-45403c6dbdb6, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=3346551a-7373-43a5-847b-45403c6dbdb6,segment=NetworkSegment(12681f3e-56a4-4c14-a93e-9cd2b361c70d),segment_id=12681f3e-56a4-4c14-a93e-9cd2b361c70d)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:57.688158 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.743125 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.750108 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2d89612d-6579-46c1-8c2e-2eafca680722 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:57.813200 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Pushing event deleted for resources: {'Port': ['ID=3346551a-7373-43a5-847b-45403c6dbdb6,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:57.815263 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] No DVR routers for this DVR port 3346551a-7373-43a5-847b-45403c6dbdb6 on host dv-cinder-793515-2-iscsi {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:44:57.816756 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:57.823412 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] Calling delete_port for 3346551a-7373-43a5-847b-45403c6dbdb6 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:57.881625 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:44:57.884346 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:57.889934 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:57.942585 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] Pushing event deleted for resources: {'Port': ['ID=3346551a-7373-43a5-847b-45403c6dbdb6,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:57.946049 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:57.950000 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b8697f8-c02f-427f-8b1d-c18ee788a077 None None] No DVR routers for this DVR port 3346551a-7373-43a5-847b-45403c6dbdb6 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:44:58.077552 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:58.092033 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a24725d30>,) {'filters': {'network_id': ['42f63911-56d5-4572-8431-a99e560ca482']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:58.105017 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a24725d30>, '12681f3e-56a4-4c14-a93e-9cd2b361c70d') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:58.105316 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a24725d30>, '12681f3e-56a4-4c14-a93e-9cd2b361c70d') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:44:58.120265 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:58.142535 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:58.149462 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Releasing vlan 759 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:44:58.149938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:44:58.163326 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:44:58.246131 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:58.251215 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:58.268607 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:58.279546 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Pushing event deleted for resources: {'Network': ['ID=42f63911-56d5-4572-8431-a99e560ca482,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:58.282769 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:44:58.293875 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-19eeb9ef-92d1-4c79-a4ff-10ece5b26455 admin admin] 10.222.0.81 "DELETE /v2.0/networks/42f63911-56d5-4572-8431-a99e560ca482 HTTP/1.1" status: 204  len: 168 time: 1.0565493
Jun 01 12:44:58.296669 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36852) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:44:58.311183 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 459514ae-5687-4f89-b04f-45365372c314 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:58.349921 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 459514ae-5687-4f89-b04f-45365372c314 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:58.350281 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 459514ae-5687-4f89-b04f-45365372c314 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:58.350788 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3346551a-7373-43a5-847b-45403c6dbdb6 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:44:58.385356 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 3346551a-7373-43a5-847b-45403c6dbdb6 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:44:58.385699 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 3346551a-7373-43a5-847b-45403c6dbdb6 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:44:58.873467 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1977861'] for router_interface, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:59.305682 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Deleting port db362eaa-5ce3-4b55-a834-f2a50ec38ae6 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:44:59.306062 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:59.432681 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] For port db362eaa-5ce3-4b55-a834-f2a50ec38ae6, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,segment=NetworkSegment(f845736a-7d73-4a5c-9544-aa3e3e70137c),segment_id=f845736a-7d73-4a5c-9544-aa3e3e70137c)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:44:59.432955 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:59.660309 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Calling delete_port for db362eaa-5ce3-4b55-a834-f2a50ec38ae6 owned by network:router_interface {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:44:59.812938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:44:59.817297 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-fb70fc91-2bee-4db6-904e-edf8a6317069 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:44:59.861012 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Pushing event deleted for resources: {'Port': ['ID=db362eaa-5ce3-4b55-a834-f2a50ec38ae6,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:44:59.863957 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:00.141393 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1587952', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1982357'] for router_interface, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:00.549978 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Router 18300301-a2ad-4993-90fe-7c3b01d4d555 has already been hosted by L3 agent c887f85a-9406-4631-9fd7-df9c0c453c1a {{(pid=91978) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
Jun 01 12:45:00.746072 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] Notify agent at l3_agent.dv-cinder-793515-2-iscsi the message routers_updated {{(pid=91978) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
Jun 01 12:45:00.754371 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] Sync routers for ids ['18300301-a2ad-4993-90fe-7c3b01d4d555'] in dv-cinder-793515-2-iscsi {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
Jun 01 12:45:00.764386 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-2299db99-fc00-4372-8cf0-3509aae945c8 admin admin] 10.222.0.81 "PUT /v2.0/routers/18300301-a2ad-4993-90fe-7c3b01d4d555/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4666543
Jun 01 12:45:00.765375 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] Routers {'18300301-a2ad-4993-90fe-7c3b01d4d555'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:45:00.766066 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe64c0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['18300301-a2ad-4993-90fe-7c3b01d4d555'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:00.766985 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36860) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:00.945004 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] Set router 18300301-a2ad-4993-90fe-7c3b01d4d555 gateway port host: dv-cinder-793515-2-iscsi {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:45:00.945844 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks [] for router, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:01.263508 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:01.281824 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe64c0>, [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'external_fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39'}], 'enable_snat': True}, 'gw_port_id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:44:59Z', 'revision_number': 5, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port': {'id': '1c1de546-761e-443c-9484-ee6cb9694b62', 'name': '', 'network_id': '44ed28c8-c80a-4954-a823-abbd3f7966bf', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:5d:93', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'device_owner': 'network:router_gateway', 'standard_attr_id': 396, 'fixed_ips': [{'subnet_id': '84d66640-a99d-4108-a81c-3480c5626219', 'ip_address': '172.27.3.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-793515-2-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-06-01T12:36:48Z', 'updated_at': '2021-06-01T12:36:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '84d66640-a99d-4108-a81c-3480c5626219', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-793515-2-iscsi'}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:01.287015 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] Checking router: 18300301-a2ad-4993-90fe-7c3b01d4d555 for host: dv-cinder-793515-2-iscsi {{(pid=91981) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
Jun 01 12:45:01.298540 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] Routers {'18300301-a2ad-4993-90fe-7c3b01d4d555'} bound to L3 agent in host dv-cinder-793515-2-iscsi {{(pid=91981) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
Jun 01 12:45:01.299462 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe64c0>, 'dv-cinder-793515-2-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-06-01T12:26:43Z,description=<?>,heartbeat_timestamp=2021-06-01T12:44:43Z,host='dv-cinder-793515-2-iscsi',id=c887f85a-9406-4631-9fd7-df9c0c453c1a,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-06-01T12:26:43Z,topic='l3_agent')) {'router_ids': ['18300301-a2ad-4993-90fe-7c3b01d4d555'], 'active': True} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:01.347558 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Deleting port 1c1de546-761e-443c-9484-ee6cb9694b62 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:45:01.348218 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:01.462993 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_dvr_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] Set router 18300301-a2ad-4993-90fe-7c3b01d4d555 gateway port host: None {{(pid=91981) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
Jun 01 12:45:01.489836 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] For port 1c1de546-761e-443c-9484-ee6cb9694b62, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=1c1de546-761e-443c-9484-ee6cb9694b62,segment=NetworkSegment(e393528e-e6c5-4c07-9e73-e139b99685c7),segment_id=e393528e-e6c5-4c07-9e73-e139b99685c7)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:01.490184 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:01.569332 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.l3_hamode_db [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f7a25fe64c0>, [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:45:01Z', 'revision_number': 6, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port_host': None}], 'dv-cinder-793515-2-iscsi', False) {} {{(pid=91981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:01.573497 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5903a8d6-21c4-4833-a36f-617fc4de44bf None None] The sync data for ids ['18300301-a2ad-4993-90fe-7c3b01d4d555'] in dv-cinder-793515-2-iscsi is: [{'id': '18300301-a2ad-4993-90fe-7c3b01d4d555', 'name': 'tempest-TestVolumeBootPattern-784118365-router', 'tenant_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-06-01T12:36:47Z', 'updated_at': '2021-06-01T12:45:01Z', 'revision_number': 6, 'project_id': 'bcdfacaebc2c46cb92fbb72bc2498b24', 'gw_port_host': None}] {{(pid=91981) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
Jun 01 12:45:01.621606 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Calling delete_port for 1c1de546-761e-443c-9484-ee6cb9694b62 owned by network:router_gateway {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:45:01.766358 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:01.770057 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-e252f4ab-8214-4503-9b7d-7be19073353a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:01.816710 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Pushing event deleted for resources: {'Port': ['ID=1c1de546-761e-443c-9484-ee6cb9694b62,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:01.846034 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:01.914911 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1981208'] for router_gateway, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.109629 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1978773', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2853'] for router, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.112536 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.144926 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-1982121'] for router, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.145425 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 18300301-a2ad-4993-90fe-7c3b01d4d555 {{(pid=91978) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
Jun 01 12:45:02.159117 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] Notify callbacks [] for router, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.160225 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-53c81c19-32ed-481e-a6f2-8ba271ce7edd admin admin] 10.222.0.81 "DELETE /v2.0/routers/18300301-a2ad-4993-90fe-7c3b01d4d555 HTTP/1.1" status: 204  len: 168 time: 1.3922946
Jun 01 12:45:02.162793 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36866) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:02.224436 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.db_base_plugin_v2 [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Deleting subnet a630deea-a2cc-4a29-9c45-3180bc13da34 {{(pid=91978) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:45:02.227516 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.286198 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2148244'] for subnet, precommit_delete_associations {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.375011 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.397501 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1c1de546-761e-443c-9484-ee6cb9694b62 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:45:02.436203 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 1c1de546-761e-443c-9484-ee6cb9694b62 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:45:02.436579 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 1c1de546-761e-443c-9484-ee6cb9694b62 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:45:02.437015 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device db362eaa-5ce3-4b55-a834-f2a50ec38ae6 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:45:02.475900 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: db362eaa-5ce3-4b55-a834-f2a50ec38ae6 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:45:02.476295 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device db362eaa-5ce3-4b55-a834-f2a50ec38ae6 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:45:02.653118 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2584218', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-3089699'] for subnet, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.656938 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-9af7e804-37b1-4ace-9b94-9200a5b9a263 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:02.695783 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.699541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a630deea-a2cc-4a29-9c45-3180bc13da34,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:02.701387 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a0aeb7e-587a-4adb-afff-fed06e0412fd None None] Network 12269b2c-6505-4483-b715-3d56d83902f2 requested from dv-cinder-793515-2-iscsi {{(pid=91980) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
Jun 01 12:45:02.704704 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:02.706855 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-510abef6-8a37-4382-b903-61c09c5a0dd7 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/a630deea-a2cc-4a29-9c45-3180bc13da34 HTTP/1.1" status: 204  len: 168 time: 0.5428326
Jun 01 12:45:02.709019 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36872) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:02.929486 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:02.978551 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] DHCP port deletion for 12269b2c-6505-4483-b715-3d56d83902f2 request from dv-cinder-793515-2-iscsi {{(pid=91980) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
Jun 01 12:45:03.010348 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Deleting port 28a4a744-87a4-4f89-859f-e79650acabd9 {{(pid=91978) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:45:03.010684 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.051103 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] Deleting port 28a4a744-87a4-4f89-859f-e79650acabd9 {{(pid=91980) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:45:03.051709 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.121186 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.db [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] For port 28a4a744-87a4-4f89-859f-e79650acabd9, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=28a4a744-87a4-4f89-859f-e79650acabd9,segment=NetworkSegment(f845736a-7d73-4a5c-9544-aa3e3e70137c),segment_id=f845736a-7d73-4a5c-9544-aa3e3e70137c)] {{(pid=91978) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:03.121590 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.205958 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] For port 28a4a744-87a4-4f89-859f-e79650acabd9, host dv-cinder-793515-2-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-793515-2-iscsi',level=0,port_id=28a4a744-87a4-4f89-859f-e79650acabd9,segment=NetworkSegment(f845736a-7d73-4a5c-9544-aa3e3e70137c),segment_id=f845736a-7d73-4a5c-9544-aa3e3e70137c)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:03.206233 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.289236 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.plugin [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Calling delete_port for 28a4a744-87a4-4f89-859f-e79650acabd9 owned by network:dhcp {{(pid=91978) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:45:03.331157 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] Calling delete_port for 28a4a744-87a4-4f89-859f-e79650acabd9 owned by network:dhcp {{(pid=91980) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:45:03.335390 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2521961'] for port, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.340268 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-2ae94ebe-aa6d-4e65-a879-72905342904f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:03.379315 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323'] for port, after_delete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.382994 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-9337a0cf-8884-400c-8ec6-9c2fcddc067b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:03.384230 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Pushing event deleted for resources: {'Port': ['ID=28a4a744-87a4-4f89-859f-e79650acabd9,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:03.386656 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] No DVR routers for this DVR port 28a4a744-87a4-4f89-859f-e79650acabd9 on host dv-cinder-793515-2-iscsi {{(pid=91978) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:45:03.388138 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:03.427494 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] Pushing event deleted for resources: {'Port': ['ID=28a4a744-87a4-4f89-859f-e79650acabd9,revision_number=None']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:03.431241 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:03.434435 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69f8cc41-f26e-4c67-afe4-90f3464a7b52 None None] No DVR routers for this DVR port 28a4a744-87a4-4f89-859f-e79650acabd9 on host dv-cinder-793515-2-iscsi {{(pid=91980) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:45:03.507909 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.522392 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a2591be50>,) {'filters': {'network_id': ['12269b2c-6505-4483-b715-3d56d83902f2']}} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:03.535964 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2591be50>, 'f845736a-7d73-4a5c-9544-aa3e3e70137c') {'for_net_delete': True} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:03.536258 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.services.segments.db [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2591be50>, 'f845736a-7d73-4a5c-9544-aa3e3e70137c') {} {{(pid=91978) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:03.549599 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2148255'] for segment, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.566629 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.573621 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Releasing vlan 774 on physical network physnet1 to pool {{(pid=91978) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:45:03.574011 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2521916'] for segment, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]: Traceback (most recent call last):
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     timer()
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     cb(*args, **kw)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     return func(*args, **kwargs)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     self._notify()
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     self.callback(batched_events)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     event.method(event)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     return f(self, *a, **k)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._get(url).json()
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:45:03.587267 dv-cinder-793515-2-iscsi neutron-server[91978]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:45:03.667098 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.670389 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:03.684182 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.694847 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Pushing event deleted for resources: {'Network': ['ID=12269b2c-6505-4483-b715-3d56d83902f2,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:03.699088 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:03.702600 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b72b6b85-37c5-4522-af79-917aee0fd6b5 admin admin] 10.222.0.81 "DELETE /v2.0/networks/12269b2c-6505-4483-b715-3d56d83902f2 HTTP/1.1" status: 204  len: 168 time: 0.9926708
Jun 01 12:45:03.816451 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36880) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:03.865031 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-dd9610f7-76d7-4988-833b-193e39e096d0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=892af7572bdb454483d1279dcfc9ccb0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0473018
Jun 01 12:45:03.867338 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36884) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:03.930348 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-103c5bf7-7a4f-4c81-9cd7-48bf24440059 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:03.959801 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-103c5bf7-7a4f-4c81-9cd7-48bf24440059 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:04.016452 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-103c5bf7-7a4f-4c81-9cd7-48bf24440059 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:04.021306 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-4aa9b351-2ffb-48de-bb01-40b7fda096f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:04.035423 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103c5bf7-7a4f-4c81-9cd7-48bf24440059 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a37cef80-dc2a-4855-9bba-1ba61f1520a2,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:04.040068 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-103c5bf7-7a4f-4c81-9cd7-48bf24440059 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:04.042638 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-103c5bf7-7a4f-4c81-9cd7-48bf24440059 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:04.043793 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-103c5bf7-7a4f-4c81-9cd7-48bf24440059 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a37cef80-dc2a-4855-9bba-1ba61f1520a2 HTTP/1.1" status: 204  len: 168 time: 0.1755831
Jun 01 12:45:04.319422 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 28a4a744-87a4-4f89-859f-e79650acabd9 no longer exists at agent ovs-agent-dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:45:04.354860 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] No Port match for: 28a4a744-87a4-4f89-859f-e79650acabd9 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:45:04.355542 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Device 28a4a744-87a4-4f89-859f-e79650acabd9 not bound to the agent host dv-cinder-793515-2-iscsi {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:45:04.399241 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36892) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:04.453025 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-6c1299fc-88fb-4427-9626-35229b217dfe admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=bcdfacaebc2c46cb92fbb72bc2498b24&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0525780
Jun 01 12:45:04.455380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 36896) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:04.516274 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b954027-2b11-43cd-b20a-ff16f969936d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:04.544878 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b954027-2b11-43cd-b20a-ff16f969936d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:04.601209 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b954027-2b11-43cd-b20a-ff16f969936d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:04.606408 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1ffbe809-c70e-412d-954a-1895657b3fbb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:04.619178 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b954027-2b11-43cd-b20a-ff16f969936d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af18be6d-b488-4598-908f-bae6ccb6e4e6,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:04.622562 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-5b954027-2b11-43cd-b20a-ff16f969936d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:04.625139 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-5b954027-2b11-43cd-b20a-ff16f969936d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:04.626547 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-5b954027-2b11-43cd-b20a-ff16f969936d admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/af18be6d-b488-4598-908f-bae6ccb6e4e6 HTTP/1.1" status: 204  len: 168 time: 0.1700363
Jun 01 12:45:06.876366 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6a70ad88-b89c-4342-8286-5164977723b4 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:06.877777 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6a70ad88-b89c-4342-8286-5164977723b4 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.1533694
Jun 01 12:45:06.893450 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-f642f81b-a4eb-4706-80bf-5a5d4685bedd tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/quotas/b6d1ef7d540a43c6869c7fa1a0838204 HTTP/1.1" status: 200  len: 375 time: 0.0102148
Jun 01 12:45:06.985493 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-91e2529e-a9ef-4938-9ebb-cb0bfb4f228e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0866816
Jun 01 12:45:07.120124 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-8d2bfe42-46a0-4b5b-b900-913e0bc6d3ea service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1275642
Jun 01 12:45:07.267771 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-999bc2cb-2ec1-497f-8ec9-3bf799db8099 service neutron] 10.222.0.81 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1406987
Jun 01 12:45:07.466587 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-14c18669-50e2-4ad1-9d79-d7e7907b8d30 req-f1895715-85a2-477a-a41b-475f8cb77e4d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 210 time: 0.0485578
Jun 01 12:45:08.544772 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-1d8dccba-f17c-435c-b80f-dda7aced379f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:08.546490 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-1d8dccba-f17c-435c-b80f-dda7aced379f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 814 time: 0.1564047
Jun 01 12:45:08.561222 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Request body: {'port': {'device_id': '58e601e8-9162-41af-b63d-0634948a7e01', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'admin_state_up': True, 'tenant_id': 'b6d1ef7d540a43c6869c7fa1a0838204'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:45:08.791721 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-27270446-2d22-4028-94ce-046ee794fd14 req-91e0037b-6fcd-4bf7-aa6f-4724c5cbea75 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 210 time: 0.2064197
Jun 01 12:45:08.846534 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:45:08.857625 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:45:08.867031 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Made reservation on behalf of b6d1ef7d540a43c6869c7fa1a0838204 for: {'port': 1} {{(pid=91979) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
Jun 01 12:45:08.870853 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.045376 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_common [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Allocated IP 172.20.0.3 (4c119a34-b195-4741-b131-afc7d89e3c41/efb47d96-d48f-48ad-9699-a0a2eb0a84b2/d8b6a8b7-cc31-4525-a8e5-4ed88493388d) {{(pid=91979) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
Jun 01 12:45:09.249406 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks [] for port, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.280679 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8760163386314', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.287332 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e96e274a-1b1f-4415-848c-92ab0056e87d tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:09.293115 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df', '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', '5ae5a07b-8e75-4d93-b058-8222e2a023d5'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:45:09.359560 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Network 4c119a34-b195-4741-b131-afc7d89e3c41 is already hosted by enough agents. {{(pid=91979) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
Jun 01 12:45:09.362803 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.scheduler.base_scheduler [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Resources bound (agent type, host, resource id):  {{(pid=91979) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
Jun 01 12:45:09.367877 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Received port after_create {{(pid=91979) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
Jun 01 12:45:09.402344 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event updated for resources: {'Port': ['ID=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:09.411024 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:09.436297 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:09.436930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.462267 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-a4aacd9a-3f43-4773-bfa8-dff8da371c18 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 0.9048805
Jun 01 12:45:09.473940 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.v2.base [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Request body: {'port': {'device_id': '58e601e8-9162-41af-b63d-0634948a7e01', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79351'}} {{(pid=91979) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
Jun 01 12:45:09.588255 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.846265 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-26d5858c-9892-468a-8732-bab52f50466b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.936461 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d8b6a8b7-cc31-4525-a8e5-4ed88493388d {{(pid=91979) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:45:09.944638 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.959622 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.provisioning_blocks [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Transition to ACTIVE for port object d8b6a8b7-cc31-4525-a8e5-4ed88493388d will not be triggered until provisioned by entity L2. {{(pid=91979) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
Jun 01 12:45:09.964305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:09.969136 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ec6fdb3d-3a26-4088-9aee-8adcf46f0730 tempest-TestVolumeBootPattern-391585697 tempest-TestVolumeBootPattern-391585697-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:09.995188 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85eef49e-5fd1-4263-bcda-c0657f046870 req-ee04dd8f-50eb-41a6-8e75-ba7c76643b2d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:09.996732 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85eef49e-5fd1-4263-bcda-c0657f046870 req-ee04dd8f-50eb-41a6-8e75-ba7c76643b2d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 931 time: 0.0874226
Jun 01 12:45:10.047298 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85eef49e-5fd1-4263-bcda-c0657f046870 req-28550b73-a6b7-44cc-84e8-cf3b14bcd5e0 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0448809
Jun 01 12:45:10.129607 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Pushing event updated for resources: {'Port': ['ID=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,revision_number=2']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:10.156104 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:10.199007 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Attempting to bind port d8b6a8b7-cc31-4525-a8e5-4ed88493388d on host hv-cinder-79351 for vnic_type normal with profile  {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
Jun 01 12:45:10.199332 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Attempting to bind port d8b6a8b7-cc31-4525-a8e5-4ed88493388d by drivers openvswitch,hyperv on host hv-cinder-79351 at level 0 using segments [{'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
Jun 01 12:45:10.199656 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Attempting to bind port d8b6a8b7-cc31-4525-a8e5-4ed88493388d on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:45:10.204602 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Port d8b6a8b7-cc31-4525-a8e5-4ed88493388d on network 4c119a34-b195-4741-b131-afc7d89e3c41 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79351 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
Jun 01 12:45:10.204915 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Attempting to bind port d8b6a8b7-cc31-4525-a8e5-4ed88493388d on network 4c119a34-b195-4741-b131-afc7d89e3c41 {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
Jun 01 12:45:10.209930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Checking agent: {'id': '78f0bfa0-22d4-4479-a473-ca9f87534946', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79351', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'started_at': datetime.datetime(2021, 6, 1, 12, 32, 42), 'heartbeat_timestamp': datetime.datetime(2021, 6, 1, 12, 44, 42), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
Jun 01 12:45:10.210240 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Checking segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91979) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
Jun 01 12:45:10.210611 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Bound using segment: {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'} {{(pid=91979) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
Jun 01 12:45:10.211025 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.managers [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Bound port: d8b6a8b7-cc31-4525-a8e5-4ed88493388d, host: hv-cinder-79351, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1342ba0-ad42-4b56-b918-8a0cd523c367', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 787, 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41'}}] {{(pid=91979) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
Jun 01 12:45:10.211361 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:10.304625 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] For port d8b6a8b7-cc31-4525-a8e5-4ed88493388d, host hv-cinder-79351, cleared binding levels {{(pid=91979) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
Jun 01 12:45:10.307638 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] For port d8b6a8b7-cc31-4525-a8e5-4ed88493388d, host hv-cinder-79351, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
Jun 01 12:45:10.312666 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2540436'] for port, after_update {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:10.316369 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:10.371118 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:10.371730 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:10.373098 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] 10.222.0.95 "PUT /v2.0/ports/d8b6a8b7-cc31-4525-a8e5-4ed88493388d HTTP/1.1" status: 200  len: 1093 time: 0.9033790
Jun 01 12:45:10.375919 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '58e601e8-9162-41af-b63d-0634948a7e01', 'tag': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:45:10.378997 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-655717ed-98df-4a43-955c-5433d6b4c26d" -d '{"events": [{"name": "network-changed", "server_uuid": "58e601e8-9162-41af-b63d-0634948a7e01", "tag": "d8b6a8b7-cc31-4525-a8e5-4ed88493388d"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:45:10.400268 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Pushing event updated for resources: {'Port': ['ID=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,revision_number=3']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:10.404040 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6e499aed-be22-4cdf-bc6e-ce1042ed2a13 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:10.490058 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-1112988c-0112-49b5-8265-9399559046fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:10.491581 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-1112988c-0112-49b5-8265-9399559046fa service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 1096 time: 0.0790195
Jun 01 12:45:10.551733 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 01 Jun 2021 12:45:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24d4a7c9-ee50-423a-a062-e6437f98a6b6 x-openstack-request-id: req-24d4a7c9-ee50-423a-a062-e6437f98a6b6 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:45:10.552054 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "58e601e8-9162-41af-b63d-0634948a7e01", "tag": "d8b6a8b7-cc31-4525-a8e5-4ed88493388d", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:45:10.552342 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-24d4a7c9-ee50-423a-a062-e6437f98a6b6 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:45:10.552789 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '58e601e8-9162-41af-b63d-0634948a7e01', 'tag': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d', 'status': 'completed', 'code': 200}
Jun 01 12:45:10.561092 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-842e1c20-5133-473d-8516-8414ead3e91d service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d8b6a8b7-cc31-4525-a8e5-4ed88493388d HTTP/1.1" status: 200  len: 217 time: 0.0619247
Jun 01 12:45:10.714275 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-94272509-c91e-4ffa-9d9e-9d8724d184f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:10.715700 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-94272509-c91e-4ffa-9d9e-9d8724d184f6 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.1489744
Jun 01 12:45:10.763473 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-992591ac-28e7-4382-bd76-08cf09f1fed5 service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0404165
Jun 01 12:45:10.893814 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-85bdbf24-95f5-4060-80eb-311094f8eeb8 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1233430
Jun 01 12:45:11.026817 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-f4e37f51-f4ef-497e-bf39-404787c89691 req-183c4cf2-f99c-49b2-bb8c-932ba7e3d425 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1238506
Jun 01 12:45:11.148731 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655717ed-98df-4a43-955c-5433d6b4c26d req-65d6d145-2ed3-4c80-ac83-2ee6c1601a4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:11.150204 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-655717ed-98df-4a43-955c-5433d6b4c26d req-65d6d145-2ed3-4c80-ac83-2ee6c1601a4c service neutron] 10.222.0.95 "GET /v2.0/ports?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 1096 time: 0.0709043
Jun 01 12:45:11.235672 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5063d6d-02e8-4557-9dea-f6252b12dc2d req-609bb610-b7ef-4e48-9f8d-ae4fc377b716 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:11.237158 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b5063d6d-02e8-4557-9dea-f6252b12dc2d req-609bb610-b7ef-4e48-9f8d-ae4fc377b716 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 943 time: 0.0811577
Jun 01 12:45:11.283681 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-b5063d6d-02e8-4557-9dea-f6252b12dc2d req-de4cc9bb-4f0e-4040-9a8f-3f974b31005c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403945
Jun 01 12:45:11.287888 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655717ed-98df-4a43-955c-5433d6b4c26d req-967a188b-98cd-4b49-b99f-cd9c8d1d7684 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:11.289368 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-655717ed-98df-4a43-955c-5433d6b4c26d req-967a188b-98cd-4b49-b99f-cd9c8d1d7684 service neutron] 10.222.0.95 "GET /v2.0/networks?id=4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 200  len: 915 time: 0.1315114
Jun 01 12:45:11.358780 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-655717ed-98df-4a43-955c-5433d6b4c26d req-bb43ffac-12c9-49e3-ad29-23dc3967bd38 service neutron] 10.222.0.95 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d8b6a8b7-cc31-4525-a8e5-4ed88493388d HTTP/1.1" status: 200  len: 217 time: 0.0630488
Jun 01 12:45:11.423187 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655717ed-98df-4a43-955c-5433d6b4c26d req-2e5762e7-69e8-4bc3-b96b-46faeaf7c604 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:11.424614 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-655717ed-98df-4a43-955c-5433d6b4c26d req-2e5762e7-69e8-4bc3-b96b-46faeaf7c604 service neutron] 10.222.0.95 "GET /v2.0/subnets?id=efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 200  len: 854 time: 0.0590615
Jun 01 12:45:11.472307 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-655717ed-98df-4a43-955c-5433d6b4c26d req-8bbf6d55-5dab-4546-932f-229a68e7b69d service neutron] 10.222.0.95 "GET /v2.0/ports?network_id=4c119a34-b195-4741-b131-afc7d89e3c41&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0406330
Jun 01 12:45:11.610371 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-655717ed-98df-4a43-955c-5433d6b4c26d req-38f0d07e-0d49-48aa-9906-15bd41e6417f service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1228943
Jun 01 12:45:11.739902 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-655717ed-98df-4a43-955c-5433d6b4c26d req-e50492fe-e887-484b-b308-ae92ababa3e4 service neutron] 10.222.0.95 "GET /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1224377
Jun 01 12:45:12.189319 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:12.325868 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:12.477802 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe6c73b-87b6-4118-a77f-5825afe4c352 req-5c6f1561-7abc-42e0-9afb-06dadc8f812c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:12.478494 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ebe6c73b-87b6-4118-a77f-5825afe4c352 req-5c6f1561-7abc-42e0-9afb-06dadc8f812c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:45:12.493962 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-ebe6c73b-87b6-4118-a77f-5825afe4c352 req-5c6f1561-7abc-42e0-9afb-06dadc8f812c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:45:12.495166 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ebe6c73b-87b6-4118-a77f-5825afe4c352 req-5c6f1561-7abc-42e0-9afb-06dadc8f812c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 943 time: 0.0962317
Jun 01 12:45:12.538583 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-ebe6c73b-87b6-4118-a77f-5825afe4c352 req-018b082b-8803-4ad5-bd44-930179633978 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377536
Jun 01 12:45:12.681347 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-fcd4d361-cba6-4946-81cb-74f6b79c299f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:13.645176 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d8b6a8b7-cc31-4525-a8e5-4ed88493388d details requested by agent hyperv_hv-cinder-79351 with host hv-cinder-79351 {{(pid=91980) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
Jun 01 12:45:13.749611 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e39501-f6b6-40f0-825b-6f12a0b4f994 req-0cf00b56-aff3-4392-8ea0-7e29cddc3aa0 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:13.751612 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d8e39501-f6b6-40f0-825b-6f12a0b4f994 req-0cf00b56-aff3-4392-8ea0-7e29cddc3aa0 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 943 time: 0.1020684
Jun 01 12:45:13.801157 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d8b6a8b7-cc31-4525-a8e5-4ed88493388d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:13.810396 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d8e39501-f6b6-40f0-825b-6f12a0b4f994 req-4709eecd-9bbd-41bc-8186-07130298f7fb tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0512197
Jun 01 12:45:13.815948 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Returning: {'device': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d', 'network_id': '4c119a34-b195-4741-b131-afc7d89e3c41', 'port_id': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d', 'mac_address': 'fa:16:3e:57:9b:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 787, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'efb47d96-d48f-48ad-9699-a0a2eb0a84b2', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91980) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
Jun 01 12:45:13.878788 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:13.904236 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d8b6a8b7-cc31-4525-a8e5-4ed88493388d {{(pid=91980) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
Jun 01 12:45:13.908219 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:13.921946 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d8b6a8b7-cc31-4525-a8e5-4ed88493388d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:13.925890 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:13.928151 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:13.997766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,revision_number=4']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:14.000652 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:14.163922 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['d8b6a8b7-cc31-4525-a8e5-4ed88493388d'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:45:15.148911 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bba4d9e-b766-4ab5-9847-037c215ba79d req-dddc2d98-d5ab-44b9-8d2c-70e802bf5132 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:15.150388 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2bba4d9e-b766-4ab5-9847-037c215ba79d req-dddc2d98-d5ab-44b9-8d2c-70e802bf5132 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 944 time: 0.0874269
Jun 01 12:45:15.198357 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2bba4d9e-b766-4ab5-9847-037c215ba79d req-78e7e3e6-51f7-478c-aefe-3be00511c448 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412061
Jun 01 12:45:15.445041 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:15.662808 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d8b6a8b7-cc31-4525-a8e5-4ed88493388d up at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
Jun 01 12:45:15.731562 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning for port d8b6a8b7-cc31-4525-a8e5-4ed88493388d completed by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
Jun 01 12:45:15.736228 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.db.provisioning_blocks [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Provisioning complete for port d8b6a8b7-cc31-4525-a8e5-4ed88493388d triggered by entity L2. {{(pid=91980) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
Jun 01 12:45:15.736638 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-984609'] for port, provisioning_complete {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:15.851781 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-970519'] for port, before_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:15.880050 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '58e601e8-9162-41af-b63d-0634948a7e01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d'}] {{(pid=91980) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:45:15.882637 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9f07de53c922b0b0d443c3c5da3ad72f4db7b80b59eb8abab269bca5d7aa580f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48635828-6d98-4ef2-9ba5-de8d89563dfd" -d '{"events": [{"server_uuid": "58e601e8-9162-41af-b63d-0634948a7e01", "name": "network-vif-plugged", "status": "completed", "tag": "d8b6a8b7-cc31-4525-a8e5-4ed88493388d"}]}' {{(pid=91980) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:45:15.890461 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] For port d8b6a8b7-cc31-4525-a8e5-4ed88493388d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91980) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:15.895379 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8760163819668', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8760163386332', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8760163387405'] for port, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:15.897900 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:15.966803 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Pushing event updated for resources: {'Port': ['ID=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,revision_number=5']} {{(pid=91980) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:15.969832 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG oslo_concurrency.lockutils [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:15.998938 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:45:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8f42463-4976-4af1-a124-b09c0b57c355 x-openstack-request-id: req-d8f42463-4976-4af1-a124-b09c0b57c355 {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:45:15.999234 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "58e601e8-9162-41af-b63d-0634948a7e01", "name": "network-vif-plugged", "status": "completed", "tag": "d8b6a8b7-cc31-4525-a8e5-4ed88493388d", "code": 200}]} {{(pid=91980) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:45:15.999541 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-d8f42463-4976-4af1-a124-b09c0b57c355 {{(pid=91980) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:45:15.999959 dv-cinder-793515-2-iscsi neutron-server[91980]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '58e601e8-9162-41af-b63d-0634948a7e01', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d', 'code': 200}
Jun 01 12:45:16.244629 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6db6fbfe-25cd-4df2-8861-0466ac7239e3 req-46043c47-80f7-467d-a43d-276a0c1a7be2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:16.246708 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6db6fbfe-25cd-4df2-8861-0466ac7239e3 req-46043c47-80f7-467d-a43d-276a0c1a7be2 service neutron] 10.222.0.95 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 1098 time: 0.0806248
Jun 01 12:45:16.299108 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-6db6fbfe-25cd-4df2-8861-0466ac7239e3 req-d19619cb-118d-4dad-945d-3b68cab00cea service neutron] 10.222.0.95 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443046
Jun 01 12:45:16.394478 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c388a003-b55b-4bf1-8a9f-087653b7f6d0 req-b7aec426-4746-41b4-9016-75acd163a233 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:16.395993 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c388a003-b55b-4bf1-8a9f-087653b7f6d0 req-b7aec426-4746-41b4-9016-75acd163a233 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 945 time: 0.0878072
Jun 01 12:45:16.448254 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-c388a003-b55b-4bf1-8a9f-087653b7f6d0 req-e9cac429-2965-4eb6-86a7-23350f5ebd01 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0463398
Jun 01 12:45:17.657114 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-344d40a6-f0b0-45d0-ac99-a18f709eeea8 req-45ded4f3-bf74-44e4-8c91-441f15dd3e78 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:17.658567 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-344d40a6-f0b0-45d0-ac99-a18f709eeea8 req-45ded4f3-bf74-44e4-8c91-441f15dd3e78 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 945 time: 0.0821044
Jun 01 12:45:17.706014 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-344d40a6-f0b0-45d0-ac99-a18f709eeea8 req-2f480629-b2e2-4831-8634-dd7e9db4a354 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398097
Jun 01 12:45:29.718430 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883b566e-cf30-4a11-983f-ee864b539b2e req-d257fb6e-3234-4259-b532-2dc922f8679c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:29.719879 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-883b566e-cf30-4a11-983f-ee864b539b2e req-d257fb6e-3234-4259-b532-2dc922f8679c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 945 time: 0.0857639
Jun 01 12:45:29.764114 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-883b566e-cf30-4a11-983f-ee864b539b2e req-5cf06752-0df6-4739-a4bd-070bdb7651c1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384507
Jun 01 12:45:30.957410 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0daafd3a-68be-4c44-b8e0-38a1c9010bb3 req-60b8602b-8c02-4812-bcd8-47c62ae82c7d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:30.958860 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0daafd3a-68be-4c44-b8e0-38a1c9010bb3 req-60b8602b-8c02-4812-bcd8-47c62ae82c7d tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 945 time: 0.0857322
Jun 01 12:45:31.004772 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0daafd3a-68be-4c44-b8e0-38a1c9010bb3 req-97d971aa-cc71-48ab-a9b2-d14f465ccd3e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402799
Jun 01 12:45:31.344604 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-68b44301-fd68-43b5-9892-048ae2f5f279 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:31.346006 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-68b44301-fd68-43b5-9892-048ae2f5f279 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 945 time: 0.0797710
Jun 01 12:45:31.579231 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Deleting port d8b6a8b7-cc31-4525-a8e5-4ed88493388d {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:45:31.579558 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:31.711850 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] For port d8b6a8b7-cc31-4525-a8e5-4ed88493388d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:31.712201 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:31.837716 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Calling delete_port for d8b6a8b7-cc31-4525-a8e5-4ed88493388d owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:45:31.948932 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:31.955300 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b4b29be1-2680-435f-b3f6-c8f7ddcf4f43 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:31.962197 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df', '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', '5ae5a07b-8e75-4d93-b058-8222e2a023d5', 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:45:32.001087 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event deleted for resources: {'Port': ['ID=d8b6a8b7-cc31-4525-a8e5-4ed88493388d,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:32.027368 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:32.080363 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] No DVR routers for this DVR port d8b6a8b7-cc31-4525-a8e5-4ed88493388d on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:45:32.083019 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:32.086220 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '58e601e8-9162-41af-b63d-0634948a7e01', 'name': 'network-vif-deleted', 'tag': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:45:32.088651 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0621b681-27ad-403d-a75a-1327b7bb2ed4" -d '{"events": [{"server_uuid": "58e601e8-9162-41af-b63d-0634948a7e01", "name": "network-vif-deleted", "tag": "d8b6a8b7-cc31-4525-a8e5-4ed88493388d"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:45:32.104920 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-36205b67-2a8f-403b-95ef-02eee2e7352b req-d45c4815-8a63-422c-8b37-1c63b5f508d1 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "DELETE /v2.0/ports/d8b6a8b7-cc31-4525-a8e5-4ed88493388d HTTP/1.1" status: 204  len: 173 time: 0.7512710
Jun 01 12:45:32.162507 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:45:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9ec280b-14e2-42d9-9817-4a17cf2bac55 x-openstack-request-id: req-f9ec280b-14e2-42d9-9817-4a17cf2bac55 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:45:32.162828 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "58e601e8-9162-41af-b63d-0634948a7e01", "name": "network-vif-deleted", "tag": "d8b6a8b7-cc31-4525-a8e5-4ed88493388d", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:45:32.163111 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-f9ec280b-14e2-42d9-9817-4a17cf2bac55 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:45:32.163532 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '58e601e8-9162-41af-b63d-0634948a7e01', 'name': 'network-vif-deleted', 'tag': 'd8b6a8b7-cc31-4525-a8e5-4ed88493388d', 'status': 'completed', 'code': 200}
Jun 01 12:45:32.177565 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-98c1602c-4e03-44fa-bd35-8ca944bad3d7 req-5ff1f976-e326-4e1a-be73-22779089e073 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=58e601e8-9162-41af-b63d-0634948a7e01 HTTP/1.1" status: 200  len: 210 time: 0.0510604
Jun 01 12:45:34.870682 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2943b4cd-ac4c-4eba-9360-1a739f4a4aff req-91d1009e-05e0-494c-82b9-86f59b9dec47 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:34.871377 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-2943b4cd-ac4c-4eba-9360-1a739f4a4aff req-91d1009e-05e0-494c-82b9-86f59b9dec47 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:45:34.879621 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:45:34.886847 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-2943b4cd-ac4c-4eba-9360-1a739f4a4aff req-91d1009e-05e0-494c-82b9-86f59b9dec47 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:45:34.887969 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2943b4cd-ac4c-4eba-9360-1a739f4a4aff req-91d1009e-05e0-494c-82b9-86f59b9dec47 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 946 time: 0.0967960
Jun 01 12:45:34.933934 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-2943b4cd-ac4c-4eba-9360-1a739f4a4aff req-658f8130-5c24-4157-98c4-832c050a5ea7 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402253
Jun 01 12:45:35.749537 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d8b6a8b7-cc31-4525-a8e5-4ed88493388d no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:45:35.783573 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: d8b6a8b7-cc31-4525-a8e5-4ed88493388d {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:45:35.783918 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device d8b6a8b7-cc31-4525-a8e5-4ed88493388d not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:45:36.123491 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed57041e-1177-4f31-a3e7-d8b8ec78eefc req-a6284775-9a36-48fe-8b64-edc6608129fe tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:36.124961 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ed57041e-1177-4f31-a3e7-d8b8ec78eefc req-a6284775-9a36-48fe-8b64-edc6608129fe tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 946 time: 0.0857520
Jun 01 12:45:36.173812 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-ed57041e-1177-4f31-a3e7-d8b8ec78eefc req-78e11fc9-13f4-40cc-a8a8-22cab6a1d02e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430253
Jun 01 12:45:36.323245 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-f0bc8a61-e28c-4ccc-8ea8-b83ff70dcdc8 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:36.324699 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-f0bc8a61-e28c-4ccc-8ea8-b83ff70dcdc8 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 946 time: 0.0811625
Jun 01 12:45:36.461832 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Deleting port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:45:36.462166 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:36.592634 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] For port 5ae5a07b-8e75-4d93-b058-8222e2a023d5, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=5ae5a07b-8e75-4d93-b058-8222e2a023d5,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:36.592985 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:36.713288 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Calling delete_port for 5ae5a07b-8e75-4d93-b058-8222e2a023d5 owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:45:36.819994 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:36.825871 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d09ba0e8-c52c-4d05-a422-be03bfaa0679 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:36.831632 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df', '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', '5ae5a07b-8e75-4d93-b058-8222e2a023d5'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:45:36.877016 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event deleted for resources: {'Port': ['ID=5ae5a07b-8e75-4d93-b058-8222e2a023d5,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:36.879539 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:36.958066 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] No DVR routers for this DVR port 5ae5a07b-8e75-4d93-b058-8222e2a023d5 on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:45:36.960813 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:36.963598 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'name': 'network-vif-deleted', 'tag': '5ae5a07b-8e75-4d93-b058-8222e2a023d5'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:45:36.966048 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96d0775b-e70e-4637-90ff-5cb5c0267e14" -d '{"events": [{"server_uuid": "dba31791-66d0-4043-8eec-6ba7f782020a", "name": "network-vif-deleted", "tag": "5ae5a07b-8e75-4d93-b058-8222e2a023d5"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:45:36.981265 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-1962aee9-86a1-4720-bf27-f12455ba6585 req-423fe02a-d61e-4e99-8188-80a7d9a5fe46 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "DELETE /v2.0/ports/5ae5a07b-8e75-4d93-b058-8222e2a023d5 HTTP/1.1" status: 204  len: 173 time: 0.6504359
Jun 01 12:45:37.012930 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:45:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3ad1348-8e45-4a6e-a23c-266e68d1fb42 x-openstack-request-id: req-f3ad1348-8e45-4a6e-a23c-266e68d1fb42 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:45:37.014186 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dba31791-66d0-4043-8eec-6ba7f782020a", "name": "network-vif-deleted", "tag": "5ae5a07b-8e75-4d93-b058-8222e2a023d5", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:45:37.014531 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-f3ad1348-8e45-4a6e-a23c-266e68d1fb42 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:45:37.016053 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dba31791-66d0-4043-8eec-6ba7f782020a', 'name': 'network-vif-deleted', 'tag': '5ae5a07b-8e75-4d93-b058-8222e2a023d5', 'status': 'completed', 'code': 200}
Jun 01 12:45:37.332181 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-9a30fb9a-2565-48a2-9215-b013474f70df req-5cd8ab18-8b93-4a7d-acac-d157ecec206c tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=dba31791-66d0-4043-8eec-6ba7f782020a HTTP/1.1" status: 200  len: 210 time: 0.0421886
Jun 01 12:45:38.784250 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1197c3-ba1e-420b-8e08-6dddd5faa280 req-7a87a452-8c55-4fb1-8275-2f3d4c738b44 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:38.784973 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-5c1197c3-ba1e-420b-8e08-6dddd5faa280 req-7a87a452-8c55-4fb1-8275-2f3d4c738b44 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:45:38.799658 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-5c1197c3-ba1e-420b-8e08-6dddd5faa280 req-7a87a452-8c55-4fb1-8275-2f3d4c738b44 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:45:38.801025 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5c1197c3-ba1e-420b-8e08-6dddd5faa280 req-7a87a452-8c55-4fb1-8275-2f3d4c738b44 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 945 time: 0.0978217
Jun 01 12:45:38.845277 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-5c1197c3-ba1e-420b-8e08-6dddd5faa280 req-4a0e04cc-b3cd-4d54-ba5f-96ecc4c1f060 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0386899
Jun 01 12:45:39.840738 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-566c3670-60a7-472c-bb5e-c812882f6227 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:40.052061 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e90784f7-18ca-4486-a656-661f951533d5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:40.053526 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e90784f7-18ca-4486-a656-661f951533d5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 945 time: 0.0865242
Jun 01 12:45:40.142184 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85344108-a286-418c-8133-157134f08979 req-68b9332a-63e5-40ac-a7f2-ae93fa940b6f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:40.143116 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85344108-a286-418c-8133-157134f08979 req-68b9332a-63e5-40ac-a7f2-ae93fa940b6f tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 945 time: 0.1885738
Jun 01 12:45:40.189908 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-85344108-a286-418c-8133-157134f08979 req-3975f00e-d164-477d-9303-9a9d339d939e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409100
Jun 01 12:45:40.288770 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Deleting port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:45:40.289111 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:40.421243 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] For port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:40.421497 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:40.547011 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Calling delete_port for 1fa74d48-8b7c-46a0-912d-7e4406c1a30d owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:45:40.658420 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:40.663876 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-767185fd-bf80-498e-a969-281283caa86b tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:40.669763 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df', '1fa74d48-8b7c-46a0-912d-7e4406c1a30d'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:45:40.711611 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event deleted for resources: {'Port': ['ID=1fa74d48-8b7c-46a0-912d-7e4406c1a30d,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:40.714698 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:40.783151 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] No DVR routers for this DVR port 1fa74d48-8b7c-46a0-912d-7e4406c1a30d on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:45:40.786065 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:40.788804 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'name': 'network-vif-deleted', 'tag': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:45:40.791064 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de061b33-2560-4c02-b5b2-b0b3008e5779" -d '{"events": [{"server_uuid": "d4b4b549-909c-441d-96cc-af20fa66dd25", "name": "network-vif-deleted", "tag": "1fa74d48-8b7c-46a0-912d-7e4406c1a30d"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:45:40.806997 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-426c4829-d375-4fc6-8d10-ef97573cbcc2 req-e41c1597-b90d-452c-9fbe-4d9d840c9bd5 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "DELETE /v2.0/ports/1fa74d48-8b7c-46a0-912d-7e4406c1a30d HTTP/1.1" status: 204  len: 173 time: 0.7454681
Jun 01 12:45:40.841174 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:45:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98084f47-a969-4247-8255-25fd14e883d7 x-openstack-request-id: req-98084f47-a969-4247-8255-25fd14e883d7 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:45:40.842008 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d4b4b549-909c-441d-96cc-af20fa66dd25", "name": "network-vif-deleted", "tag": "1fa74d48-8b7c-46a0-912d-7e4406c1a30d", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:45:40.843297 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-98084f47-a969-4247-8255-25fd14e883d7 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:45:40.844079 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd4b4b549-909c-441d-96cc-af20fa66dd25', 'name': 'network-vif-deleted', 'tag': '1fa74d48-8b7c-46a0-912d-7e4406c1a30d', 'status': 'completed', 'code': 200}
Jun 01 12:45:41.354717 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-d286f472-4791-4224-91ac-8c620025820b req-7131127b-62c5-4df6-a36b-13294118818e tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=d4b4b549-909c-441d-96cc-af20fa66dd25 HTTP/1.1" status: 200  len: 210 time: 0.0429654
Jun 01 12:45:41.784855 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 5ae5a07b-8e75-4d93-b058-8222e2a023d5 no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:45:41.819192 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 5ae5a07b-8e75-4d93-b058-8222e2a023d5 {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:45:41.819571 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 5ae5a07b-8e75-4d93-b058-8222e2a023d5 not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:45:42.187973 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:42.329222 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:42.686066 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7554486d-f907-46d3-8de4-68ee0f0c068d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:43.783431 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 1fa74d48-8b7c-46a0-912d-7e4406c1a30d no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:45:43.817115 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: 1fa74d48-8b7c-46a0-912d-7e4406c1a30d {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:45:43.817460 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device 1fa74d48-8b7c-46a0-912d-7e4406c1a30d not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:45:43.891765 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:44.046258 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be596bf-2b79-4aaf-8d21-e422ab872669 req-4c9a83a9-e386-4ef5-a150-fe79cd8d5298 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:44.047264 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-0be596bf-2b79-4aaf-8d21-e422ab872669 req-4c9a83a9-e386-4ef5-a150-fe79cd8d5298 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Synchronizing usage tracker for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
Jun 01 12:45:44.068670 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [req-0be596bf-2b79-4aaf-8d21-e422ab872669 req-4c9a83a9-e386-4ef5-a150-fe79cd8d5298 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Unset dirty status for tenant:b6d1ef7d540a43c6869c7fa1a0838204 on resource:port {{(pid=91979) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
Jun 01 12:45:44.069814 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0be596bf-2b79-4aaf-8d21-e422ab872669 req-4c9a83a9-e386-4ef5-a150-fe79cd8d5298 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 945 time: 0.1124811
Jun 01 12:45:44.114702 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-0be596bf-2b79-4aaf-8d21-e422ab872669 req-e2ed6b61-2802-45c3-8efa-df29138f6845 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391459
Jun 01 12:45:45.349552 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58be0bea-6181-43f0-92b5-951c6d9de390 req-4c28dcda-65e3-4360-975f-acfaefb82747 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91978) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:45.351016 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-58be0bea-6181-43f0-92b5-951c6d9de390 req-4c28dcda-65e3-4360-975f-acfaefb82747 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 945 time: 0.0961049
Jun 01 12:45:45.399610 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-58be0bea-6181-43f0-92b5-951c6d9de390 req-f683a8c3-18ea-4104-84bd-d0d9d40e2c06 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/security-groups?id=eac69940-43b4-4194-a655-6a2e5c9315d3&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0426562
Jun 01 12:45:45.443870 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-8d51dd15-7f0a-41f8-85f0-abf5776dda6a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91979) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
Jun 01 12:45:45.445679 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-8d51dd15-7f0a-41f8-85f0-abf5776dda6a tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 945 time: 0.0880730
Jun 01 12:45:45.468978 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:45.621305 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Deleting port b9b80ed8-675e-4b51-841b-3ea3c15637df {{(pid=91979) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
Jun 01 12:45:45.621717 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8760163817539'] for port, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:45.770217 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.db [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] For port b9b80ed8-675e-4b51-841b-3ea3c15637df, host hv-cinder-79351, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79351',level=0,port_id=b9b80ed8-675e-4b51-841b-3ea3c15637df,segment=NetworkSegment(d1342ba0-ad42-4b56-b918-8a0cd523c367),segment_id=d1342ba0-ad42-4b56-b918-8a0cd523c367)] {{(pid=91979) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
Jun 01 12:45:45.770677 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1976020'] for port, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:45.911289 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.plugin [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Calling delete_port for b9b80ed8-675e-4b51-841b-3ea3c15637df owned by compute:nova {{(pid=91979) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
Jun 01 12:45:46.054121 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-967360', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122202', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8760163819686', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8760163386323', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2540445'] for port, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:46.061038 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b70ea438-3ad4-4038-b4ff-207be09e3f82 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:46.068284 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.db [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] get_ports_and_sgs() called for port_ids ['b9b80ed8-675e-4b51-841b-3ea3c15637df'] {{(pid=91980) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
Jun 01 12:45:46.107749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Pushing event deleted for resources: {'Port': ['ID=b9b80ed8-675e-4b51-841b-3ea3c15637df,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:46.111510 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:46.190163 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.l3_dvrscheduler_db [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] No DVR routers for this DVR port b9b80ed8-675e-4b51-841b-3ea3c15637df on host hv-cinder-79351 {{(pid=91979) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
Jun 01 12:45:46.192763 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-514268'] for port, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:46.195454 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'name': 'network-vif-deleted', 'tag': 'b9b80ed8-675e-4b51-841b-3ea3c15637df'}] {{(pid=91979) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
Jun 01 12:45:46.197807 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.81/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}19be655216f9c0c26c813c48cee6d6f64274e489e05f1b14895ce214f5669f5d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-462add0b-b1dc-42a3-b624-f2180defdee3" -d '{"events": [{"server_uuid": "6ea67e11-a8c6-41ef-9270-1aa43840c870", "name": "network-vif-deleted", "tag": "b9b80ed8-675e-4b51-841b-3ea3c15637df"}]}' {{(pid=91979) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}}
Jun 01 12:45:46.214802 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [req-bfadace8-6bed-42fc-898d-4220dcc7ca1e req-25fc8c8f-6720-41ae-b090-fd437423dc15 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.95 "DELETE /v2.0/ports/b9b80ed8-675e-4b51-841b-3ea3c15637df HTTP/1.1" status: 204  len: 173 time: 0.7627439
Jun 01 12:45:46.258175 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 01 Jun 2021 12:45:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96fbb9e8-9e0d-4c3f-a452-9c411de350c4 x-openstack-request-id: req-96fbb9e8-9e0d-4c3f-a452-9c411de350c4 {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}}
Jun 01 12:45:46.258530 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6ea67e11-a8c6-41ef-9270-1aa43840c870", "name": "network-vif-deleted", "tag": "b9b80ed8-675e-4b51-841b-3ea3c15637df", "status": "completed", "code": 200}]} {{(pid=91979) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}}
Jun 01 12:45:46.258836 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.81/compute/v2.1/os-server-external-events used request id req-96fbb9e8-9e0d-4c3f-a452-9c411de350c4 {{(pid=91979) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}}
Jun 01 12:45:46.259258 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6ea67e11-a8c6-41ef-9270-1aa43840c870', 'name': 'network-vif-deleted', 'tag': 'b9b80ed8-675e-4b51-841b-3ea3c15637df', 'status': 'completed', 'code': 200}
Jun 01 12:45:46.748949 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [req-23be40c2-e457-4bd1-8147-2889af7e3ece req-c2c59841-6907-4c21-80db-e71c3458a006 tempest-AttachVolumeNegativeTest-133397271 tempest-AttachVolumeNegativeTest-133397271-project] 10.222.0.81 "GET /v2.0/ports?device_id=6ea67e11-a8c6-41ef-9270-1aa43840c870 HTTP/1.1" status: 200  len: 210 time: 0.0457928
Jun 01 12:45:47.876085 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37082) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:47.965217 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.db_base_plugin_v2 [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Deleting subnet efb47d96-d48f-48ad-9699-a0a2eb0a84b2 {{(pid=91979) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
Jun 01 12:45:47.968580 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.117024 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2204557'] for subnet, precommit_delete_associations {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.175364 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-994267'] for subnet, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.437554 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-988782', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-122213', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1587938', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2610798', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2345669'] for subnet, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.443008 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-339c922d-c65c-4004-b8e7-681436b390cf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:48.479070 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=efb47d96-d48f-48ad-9699-a0a2eb0a84b2,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:48.484745 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for subnet, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.494466 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.494841 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.495243 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.495554 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.495910 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.496264 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.496646 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.497048 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.497399 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.497749 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.498092 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.498548 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91979) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:48.502925 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] 10.222.0.81 "DELETE /v2.0/subnets/efb47d96-d48f-48ad-9699-a0a2eb0a84b2 HTTP/1.1" status: 204  len: 168 time: 0.6255002
Jun 01 12:45:48.503945 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-ffeccfcd-d290-425e-adc8-66ed2573becd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:48.506736 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37086) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:48.617244 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-606895'] for network, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.746329 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-990804', 'neutron.services.segments.db._delete_segments_for_network-8760163830492'] for network, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.768874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f7a2407b700>,) {'filters': {'network_id': ['4c119a34-b195-4741-b131-afc7d89e3c41']}} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:48.784355 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2407b700>, 'd1342ba0-ad42-4b56-b918-8a0cd523c367') {'for_net_delete': True} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:48.784783 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.services.segments.db [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f7a2407b700>, 'd1342ba0-ad42-4b56-b918-8a0cd523c367') {} {{(pid=91979) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
Jun 01 12:45:48.798843 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8760163840157', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2204550'] for segment, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.823566 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492'] for segment, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.830248 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Releasing vlan 787 on physical network physnet1 to pool {{(pid=91979) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
Jun 01 12:45:48.830637 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-992492', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2540488'] for segment, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]: Traceback (most recent call last):
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     timer()
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     cb(*args, **kw)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     return func(*args, **kwargs)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     self._notify()
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     self.callback(batched_events)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     event.method(event)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_id = self._get_aggregate_id(event.segment_id)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     aggregate_uuid = self.p_client.list_aggregates(
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     return f(self, *a, **k)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._get(url).json()
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self._client.get(url, endpoint_filter=self._ks_filter,
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     return self.request(url, 'GET', **kwargs)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     base_url = self.get_endpoint(auth, allow=allow,
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     auth = self._auth_required(auth, 'determine endpoint URL')
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
Jun 01 12:45:48.845386 dv-cinder-793515-2-iscsi neutron-server[91979]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
Jun 01 12:45:48.924426 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-990813', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-2034231', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-1587961', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1981189'] for network, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.928251 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d07fb1dc-bfb5-4cab-9156-c5af9b9affb7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:48.942715 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1587932'] for network, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:48.954711 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Pushing event deleted for resources: {'Network': ['ID=4c119a34-b195-4741-b131-afc7d89e3c41,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:48.958406 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:48.966931 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c1a2cc91-60b4-4dd3-8550-1d6f7de69cc7 admin admin] 10.222.0.81 "DELETE /v2.0/networks/4c119a34-b195-4741-b131-afc7d89e3c41 HTTP/1.1" status: 204  len: 168 time: 0.4588304
Jun 01 12:45:49.164039 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37092) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:49.215303 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-34706030-67e7-494c-9665-959ab47527e4 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=b6d1ef7d540a43c6869c7fa1a0838204&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0498810
Jun 01 12:45:49.217659 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37096) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:45:49.283842 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:49.312743 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:49.368764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:49.372621 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-3008a606-5705-4d41-a2cf-0af4e8f5c838 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:45:49.387051 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eac69940-43b4-4194-a655-6a2e5c9315d3,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:45:49.397441 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.397820 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.398275 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.398617 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.398992 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.399371 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.399729 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.400085 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.400489 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.400862 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.401235 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.401591 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-793515-2-iscsi {{(pid=91978) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
Jun 01 12:45:49.406492 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:45:49.411405 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:45:49.412717 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-1487a1da-4c81-4816-aa42-82d91e151cfe admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/eac69940-43b4-4194-a655-6a2e5c9315d3 HTTP/1.1" status: 204  len: 168 time: 0.1938434
Jun 01 12:45:49.799252 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device b9b80ed8-675e-4b51-841b-3ea3c15637df no longer exists at agent hyperv_hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
Jun 01 12:45:49.837994 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.plugin [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] No Port match for: b9b80ed8-675e-4b51-841b-3ea3c15637df {{(pid=91980) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
Jun 01 12:45:49.838265 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron.plugins.ml2.rpc [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Device b9b80ed8-675e-4b51-841b-3ea3c15637df not bound to the agent host hv-cinder-79351 {{(pid=91980) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
Jun 01 12:46:00.198740 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37212) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:00.324120 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:00.338994 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:00.342799 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Usage tracker for resource:security_group_rule and tenant:39116685ee8748f0809b3181421176e9 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:00.345635 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:00.351893 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:00.435261 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:00.439319 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:00.447035 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-f5b6b799-a46d-4c83-849a-5b1a05603d53 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:00.491961 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=39116685ee8748f0809b3181421176e9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2915299
Jun 01 12:46:00.493026 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23092786-ae58-452f-9067-c5d8d4881916,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:00.495883 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37218) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:00.496459 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:00.560921 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6546856c-5a8d-4746-9fbc-d42f966ea155 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:00.590392 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6546856c-5a8d-4746-9fbc-d42f966ea155 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:00.646794 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6546856c-5a8d-4746-9fbc-d42f966ea155 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:00.650567 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-3ed7bd73-4974-4a7c-83c4-aed3d2210ce2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:00.663318 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6546856c-5a8d-4746-9fbc-d42f966ea155 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23092786-ae58-452f-9067-c5d8d4881916,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:00.666252 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6546856c-5a8d-4746-9fbc-d42f966ea155 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:00.668171 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-6546856c-5a8d-4746-9fbc-d42f966ea155 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:00.669750 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-6546856c-5a8d-4746-9fbc-d42f966ea155 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/23092786-ae58-452f-9067-c5d8d4881916 HTTP/1.1" status: 204  len: 168 time: 0.1722682
Jun 01 12:46:05.414736 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37292) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:05.546540 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:05.564343 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:05.568547 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Usage tracker for resource:security_group_rule and tenant:4d69e4dbc8fc4988b95ce2d7b24d3cd3 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:05.571398 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:05.577156 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:05.700428 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:05.705321 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:05.717976 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-59b94eb9-b62c-43af-b812-ac60629000ac tempest-TestShelveInstance-1606179047 tempest-TestShelveInstance-1606179047-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:05.764836 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=4d69e4dbc8fc4988b95ce2d7b24d3cd3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3489871
Jun 01 12:46:05.766764 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64f18cfe-41e1-40af-b2e5-dc38c3c1d5c3,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:05.769372 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37298) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:05.771077 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-c1c28b01-9e38-4c39-b956-753cecb1f05b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:05.850541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:05.883694 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:05.940970 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:05.946608 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7e613bc7-677a-4ea0-830c-cfb5ad4f5b47 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:05.961611 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64f18cfe-41e1-40af-b2e5-dc38c3c1d5c3,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:05.965288 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:05.974675 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:05.978880 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/64f18cfe-41e1-40af-b2e5-dc38c3c1d5c3 HTTP/1.1" status: 204  len: 168 time: 0.2047489
Jun 01 12:46:06.316729 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37306) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:06.335369 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:06.351149 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:06.355261 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Usage tracker for resource:security_group_rule and tenant:6284c55700a64924ad92ad56f01668f6 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:06.358192 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:06.364819 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:06.470764 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:06.476161 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:06.487154 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-34747511-81a0-4da9-9034-a44803956f10 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:06.544872 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=6284c55700a64924ad92ad56f01668f6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2261510
Jun 01 12:46:06.548006 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37310) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:06.560380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08429557-49e6-40d1-b452-6e2791d2b126,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:06.563759 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-4bc92db0-04c1-4de1-8472-540d8ab79bfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:06.622217 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d03633a4-3795-42bf-a00e-9d6726710934 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:06.651172 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d03633a4-3795-42bf-a00e-9d6726710934 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:06.714401 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d03633a4-3795-42bf-a00e-9d6726710934 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:06.719101 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-891816e1-21c0-4d8e-9a2e-013daa6bb468 tempest-AttachVolumeTestJSON-1518018493 tempest-AttachVolumeTestJSON-1518018493-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:06.733127 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03633a4-3795-42bf-a00e-9d6726710934 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08429557-49e6-40d1-b452-6e2791d2b126,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:06.736041 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d03633a4-3795-42bf-a00e-9d6726710934 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:06.738146 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d03633a4-3795-42bf-a00e-9d6726710934 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:06.739218 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d03633a4-3795-42bf-a00e-9d6726710934 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/08429557-49e6-40d1-b452-6e2791d2b126 HTTP/1.1" status: 204  len: 168 time: 0.1902175
Jun 01 12:46:08.151950 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37342) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:08.304026 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:08.323374 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:08.327363 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Usage tracker for resource:security_group_rule and tenant:7ba639317a5a4f12955ea1bae8be8508 is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:08.330661 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:08.337708 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:08.431291 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:08.439953 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:08.450331 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-67701ed3-4303-4f4d-8bab-11bd6d5951ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:08.493502 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=7ba639317a5a4f12955ea1bae8be8508&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3403878
Jun 01 12:46:08.494408 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69491670-8f3d-40a7-b069-db1b696baee3,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:08.496222 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37348) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:08.497506 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:08.565191 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:08.599006 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:08.659086 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:08.664409 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-d320a214-b8b0-43f3-8aa7-5befec2a6077 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:08.678727 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69491670-8f3d-40a7-b069-db1b696baee3,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:08.682991 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:08.689248 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:08.690378 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/69491670-8f3d-40a7-b069-db1b696baee3 HTTP/1.1" status: 204  len: 168 time: 0.1925166
Jun 01 12:46:09.847618 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-43458d82-6c81-4dd2-8251-040d50292a4a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:11.879549 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:46:12.203246 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:12.334096 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:12.690727 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-a5010384-7277-467f-b71a-d78e1d2ad6e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:13.894211 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:15.446350 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:17.713563 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37468) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:17.830376 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:17.844288 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:17.848119 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Usage tracker for resource:security_group_rule and tenant:1a9a5daeaeba4c7ba9131fc5a470604f is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:17.850931 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:17.856593 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:17.935713 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:17.939630 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:17.952786 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-364071bb-1a23-4e89-9684-3eaf1aa22494 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:17.993367 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=1a9a5daeaeba4c7ba9131fc5a470604f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2787778
Jun 01 12:46:17.994348 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a75c759-8878-4841-86f2-3cdfb73fd90f,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:17.997179 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37474) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:17.997705 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-b680ca87-ecf0-413a-bdfe-2173a42235f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:18.056541 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b523c7a9-fcd1-422b-862f-4826c6728958 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.082955 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b523c7a9-fcd1-422b-862f-4826c6728958 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.133874 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b523c7a9-fcd1-422b-862f-4826c6728958 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.137621 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-267b09df-2b10-4c84-b38d-a5de93f74fda admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:18.150504 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b523c7a9-fcd1-422b-862f-4826c6728958 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a75c759-8878-4841-86f2-3cdfb73fd90f,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:18.154288 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-b523c7a9-fcd1-422b-862f-4826c6728958 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:18.160047 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-b523c7a9-fcd1-422b-862f-4826c6728958 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.163522 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-b523c7a9-fcd1-422b-862f-4826c6728958 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7a75c759-8878-4841-86f2-3cdfb73fd90f HTTP/1.1" status: 204  len: 168 time: 0.1627734
Jun 01 12:46:18.437956 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37482) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:18.459634 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.474370 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:18.478206 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Usage tracker for resource:security_group_rule and tenant:b9e67354218e4009b13d8629b56c629a is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:18.481001 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:18.486663 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:18.572142 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.575817 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.584142 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-d752e54d-e16c-4822-a5af-8610a26a74b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:18.623493 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=b9e67354218e4009b13d8629b56c629a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1842678
Jun 01 12:46:18.625215 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=661f539b-615f-49b8-84e7-c8bf6a5b00a4,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:18.626168 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37486) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:18.628399 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-928f1dfb-c7bb-4fa1-a384-40d619183b70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:18.684279 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.713465 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.764988 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.768719 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-6b5e25ab-0766-4094-9a41-0cd72290c5ab tempest-AttachVolumeShelveTestJSON-972105344 tempest-AttachVolumeShelveTestJSON-972105344-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:18.780551 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=661f539b-615f-49b8-84e7-c8bf6a5b00a4,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:18.782866 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:18.792360 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:18.793488 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/661f539b-615f-49b8-84e7-c8bf6a5b00a4 HTTP/1.1" status: 204  len: 168 time: 0.1663775
Jun 01 12:46:19.135939 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37494) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:19.153867 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:19.169179 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:19.173276 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Usage tracker for resource:security_group_rule and tenant:fe95287b32834f559979a4923d887ef2 is out of sync, need to count used quota {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:19.176196 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.quota.resource [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91979) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:19.181874 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.db.quota.driver [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91979) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:19.267453 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:19.272123 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:19.278811 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-91ccc0a5-d5a7-413a-b53e-feaa7ff4e7f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:19.319350 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=fe95287b32834f559979a4923d887ef2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1823015
Jun 01 12:46:19.320278 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbf135ff-c291-4b32-9d40-8d005f8d9d80,revision_number=1']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:19.322006 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37498) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:19.323317 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-79640c37-7ca6-48e7-bdb3-b09fe615ff5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:19.385415 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01c16102-f759-4908-9bf2-e769eac75a3b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:19.410519 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01c16102-f759-4908-9bf2-e769eac75a3b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:19.462166 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01c16102-f759-4908-9bf2-e769eac75a3b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:19.467763 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-a974e98d-cf1d-4009-935f-bf3674481c60 tempest-TestMinimumBasicScenario-310047747 tempest-TestMinimumBasicScenario-310047747-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:19.483201 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c16102-f759-4908-9bf2-e769eac75a3b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbf135ff-c291-4b32-9d40-8d005f8d9d80,revision_number=None']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:19.485487 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-01c16102-f759-4908-9bf2-e769eac75a3b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:19.494202 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-01c16102-f759-4908-9bf2-e769eac75a3b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:19.495326 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-01c16102-f759-4908-9bf2-e769eac75a3b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/dbf135ff-c291-4b32-9d40-8d005f8d9d80 HTTP/1.1" status: 204  len: 168 time: 0.1716166
Jun 01 12:46:23.439158 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.wsgi [-] (91978) accepted ('10.222.0.81', 37544) {{(pid=91978) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:23.555282 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:23.569380 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
Jun 01 12:46:23.573162 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Usage tracker for resource:security_group_rule and tenant:434093716e564fc79243f2754d2c0f5c is out of sync, need to count used quota {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
Jun 01 12:46:23.575973 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.quota.resource [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91978) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
Jun 01 12:46:23.581744 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.db.quota.driver [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91978) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
Jun 01 12:46:23.665011 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:23.668791 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron_lib.callbacks.manager [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_create {{(pid=91978) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:23.677455 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-7359df8b-185e-4ceb-9268-2a834be4593b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:23.716846 dv-cinder-793515-2-iscsi neutron-server[91978]: INFO neutron.wsgi [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=434093716e564fc79243f2754d2c0f5c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2765787
Jun 01 12:46:23.718484 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b963637a-abe1-4b43-82d7-c50a9910aa77,revision_number=1']} {{(pid=91978) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:23.719586 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.wsgi [-] (91979) accepted ('10.222.0.81', 37550) {{(pid=91979) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
Jun 01 12:46:23.722191 dv-cinder-793515-2-iscsi neutron-server[91978]: DEBUG oslo_concurrency.lockutils [None req-15a17dff-3d89-45c2-bbcf-ae346938896f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:23.778869 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ad3fe5c-c2b2-43f5-b529-a3b6533042d9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:23.804202 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ad3fe5c-c2b2-43f5-b529-a3b6533042d9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:23.857753 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ad3fe5c-c2b2-43f5-b529-a3b6533042d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2034295'] for security_group, after_delete {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:23.861985 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-956708fc-9664-41a8-b594-b0e38140c8a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
Jun 01 12:46:23.875429 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad3fe5c-c2b2-43f5-b529-a3b6533042d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b963637a-abe1-4b43-82d7-c50a9910aa77,revision_number=None']} {{(pid=91979) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
Jun 01 12:46:23.879064 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG oslo_concurrency.lockutils [None req-9ad3fe5c-c2b2-43f5-b529-a3b6533042d9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
Jun 01 12:46:23.884627 dv-cinder-793515-2-iscsi neutron-server[91979]: DEBUG neutron_lib.callbacks.manager [None req-9ad3fe5c-c2b2-43f5-b529-a3b6533042d9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91979) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:23.885728 dv-cinder-793515-2-iscsi neutron-server[91979]: INFO neutron.wsgi [None req-9ad3fe5c-c2b2-43f5-b529-a3b6533042d9 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b963637a-abe1-4b43-82d7-c50a9910aa77 HTTP/1.1" status: 204  len: 168 time: 0.1644692
Jun 01 12:46:39.844436 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-91be63c4-23a9-4935-9717-3c18cd0a2066 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:42.208598 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:42.332134 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:42.699349 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-034698d5-cc17-46c3-8996-87dcf18382b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:43.896626 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:45.450766 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:46:48.880047 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:47:09.838104 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-b358d17b-e571-4d49-ad75-f870c64869d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:12.227498 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:12.325670 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:12.691726 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f78dd620-cd51-4002-9b71-e6ceb44e7272 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:13.899281 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:15.449670 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:25.879333 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:47:39.841799 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-e2d1a83f-4846-4c2f-81a2-b2c42580636f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:42.230615 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:42.328063 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:42.694263 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-3c576319-e7f2-4fab-a908-2a56c220a98b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:43.900895 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:47:45.451722 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:02.879436 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:48:09.844399 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-48d7b8b7-7d1c-4ca8-b590-2a763229e2ca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:12.252133 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:12.330023 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:12.697009 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-6e7f2201-8f62-40b9-8ad4-921c11071cdb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:13.903555 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:15.455524 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:39.848779 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-873afaae-861c-446a-8a5c-92d9fca0ab95 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:39.877986 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:48:42.243908 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:42.333742 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:42.698438 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-7a70bfcb-5e4e-4300-a68a-1026f9ef04ba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:43.906789 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:48:45.457841 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:09.851218 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-9b160f83-8945-441e-85ea-2c447e9a284d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:12.264988 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:12.340044 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:12.699306 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-cb70899b-1e72-4a8f-a5f3-21b7ab6348a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:13.912360 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:15.461105 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:16.877501 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:49:39.853346 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-3e526c98-888c-4136-a7b6-7eeff5a1d007 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:42.260247 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:42.331827 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:42.700588 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-4bcfd955-a5f7-4891-9d96-d4b0c6031eca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:43.913639 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:45.464792 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:49:53.876728 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:50:09.856472 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-39b1ab39-3509-4b58-81a5-7979f4c731aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:12.272567 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:12.333736 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:12.701949 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-954484a8-43dc-4841-8786-454742dc6cd8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:13.916840 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:15.468754 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:30.876177 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:50:39.858026 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-f880bd87-38ae-4f83-9133-375a34f89620 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:42.271110 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:42.335344 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:42.703528 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-d70a42b5-4734-43b1-8d11-bf2dab05d6c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:43.918468 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:50:45.471599 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:51:07.875531 dv-cinder-793515-2-iscsi neutron-server[91981]: DEBUG neutron.db.agents_db [None req-591ccb86-527f-4a88-b18a-01d22b66232f None None] Agent healthcheck: found 6 active agents {{(pid=91981) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
Jun 01 12:51:09.861491 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-3815fa6d-bf8f-4665-bac6-48a0fd74d1c2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:51:12.301106 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-10396e1a-12ca-4609-b18b-3b30481f55ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:51:12.337174 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-34ccda57-109f-421c-8d42-478a2962ee30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:51:12.710148 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-ba65182a-affa-45e6-b6f5-6a3274d8895c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:51:13.922732 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-11998163-c42c-45b4-9d03-24827ae46c24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
Jun 01 12:51:15.474794 dv-cinder-793515-2-iscsi neutron-server[91980]: DEBUG neutron_lib.callbacks.manager [None req-1c3979db-2dcd-4adb-b331-087fb9038b74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8760163830510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-984986'] for agent, after_update {{(pid=91980) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}